I have been using Outernet for a little while now. So far I have received many things including community data, news, Wikipedia articles (some of them pretty large), APRS feed and the weather grib2 files. However, the Weather.html (downloading as d4e8-Weather.tbz2) has never gotten past 98% or 99%. I have tried deleting everything in /mnt/cache but it eventually pops the partial file back in there with about 600kb already filled in but says it is starting at 0% on the status page.
My SNR varies between the high 3s and the high 5s with an average around 4.
Iāve seen others say the same thing. Iād just like to understand why when I delete the entire cache folder it downloads many things (seems like they were stuck) then starts out by creating a ~600KB file and shows the weather file at 0%. It slowly downloads until it gets in the 90s for percent complete then stops. The first time I left it alone for almost 4 days. Only today did I start trying to delete the cache and see if that helps. Each time I delete the cache a bunch of new data downloads until it gets stuck on Weather again.
Is there an explanation on how the carousel works so I can understand what is going on? Or maybe a debug mode of some sort? Other large files download fine, see below.
The Wikipedia article grew from just a few bytes to the size seen in the cache folder in the first picture above. This is how all other files seem to behave.
Oh and here is the Wikipedia file in its proper place:
-rw-rw-r-- 1 postgres postgres 495972 Jan 3 00:10 /mnt/downloads/Wikipedia/Fergie_(singer).html
The other large files are ānewerā and thus have higher priority than the Weather.tbz2 file. So they go around the carousel more often that the Weather file does. Also, higher priority files can interrupt lower priority files (so the news updates every hour for example will temporarily interrupt Weather). Weather is pretty much the only file that is āpermanentlyā on the carousel.
Its still surprising you have not received the Weather.tbz2 after three days. I am going to re-up its priority. It should not take more than about a day.
That said, it looks like you are fairly technically proficient. You should try the Skylark release - it has the Weather.tbz2 built in and thus does not need to download it off the air.
Well that makes more sense. Is the carousel proprietary or is there some sort of document or diagram explaining how it works down to the packet level? Just curious.
Yes I am fairly technical and would like to help with this project as time permits. I know python well enough to fix small things but I am better at C/C++/C#. My background also includes networking technologies down to the frame level (and layer 1 of course).
I figured the Skylark release had it built-in, but part of the enjoyment of this has been receiving data from a satellite. Anyway since you adjusted the priority Iāll wait a day just to see what happens. If it is still not making good progress then Iāll drop Skylark on there. Any specific feedback you guys are looking for with Skylark?
Re skylark: We are mainly looking at improving the stability and performance compared to Librarian. As you might have noticed by now, Librarian has pretty bad performance. It also degrades quite badly as the number of files downloaded increases.
So general usability, bugs, stability, performance.
One advantage Librarian still has over Skylark is, give thats its a basic UI, its very usable on Mobile, while Skylark currently is not. That is still a work in progress.
Sounds good. I havenāt noticed the performance hit yet.
Iāll upgrade to Skylark later this week, just want to give it one last chance to pull down that file.
I will miss browsing on my phone. It may seem silly but I enjoy reading the news and other items instead of just accessing them on the Internet directly.
kf4hzu. Read the exchange on this thread and it helped me understand what was going on with the weather download. It was my understanding that Skylark wonāt be available for the RPi 3 - am I correct? If it is planned also for the RPi, Iāll replace Librarian based on this discussion.
Iāve been experiencing this same problem. d4e8-Weather.tbz2 had been trying to download for almost a week. But I have been patiently waiting for Skylarks full release.
Ditto. I have been stuck at 99% since Saturday 12/31. Getting plenty of other data, so hopefully re-uping its priority will resolve this shortly. Looking forward to useful weather information.
Adding my name to the list, Iāve been running continously since about December 27, the weather download very slowly built up to 99% and seems stuck there for the last few days. At first I would SSH in and reboot if it looked like it was stuck (which seemed to be the case at 66%), I stopped doing that after reading the forums, and it eventually got up to 99%, but seems to be unable to get past that point, even though other files seem to come down just fine. Itās been stuck at 99% for about 3-4 days, and as you can see below itās run for 5 days without reboot.
Of note, even though most of the time I get a strong signal, anywhere from 5-8 db SNR, due trees to the south (and possibly weather), it occasionally drops below 3db and will drop a few packets. You can see in the current run Iāve received 380320 packets and dropped 242 over the last 5 days. Various other files seem to interrupt the Weather download and AFAICT they complete just fine (including quite a few grib2 files, news files, wikipedia articles etc, see āduā list below).
Iām running rxOS 3.1 on a RasPi 3, battery backed against power failure. Using the outernet patch antenna, nooelec SNA and RTL-SDR.com v3 SDR.
no, you are right. there is definitely a problem with the Weather.tbz2.
I am still working on it, though at this point its clear that the experiment with transferring an important component of the system - the weather app - over the satellite link, has not been very satisfactory.
Thats why the weather app is preintegrated in the new Skylark firmware.
To checkout the Weather app in Librarian, you can get a copy of the Weather.tbz2 from:
Place the tbz2 file in the āopaksā directory, give the system a few minutes to take care of it, and then you should be able to use the weather app.
Of course, at this point I am encouraging everyone to switch to the Skylark firmware.
(Sorry, I just got back to this)ā¦ How many minutes do you think? I copied the file out there a couple hours ago. It showed up immediately in the web interface for the opaks directory, but it doesnāt look like its been picked up. Reboot needed? [rxOS][jay@rxos:/mnt/external/opaks]$ date Fri Jan 6 21:56:46 UTC 2017 [rxOS][jay@rxos:/mnt/external/opaks]$ ls -lat total 832 drwxr-xr-x 2 root root 4096 Jan 6 21:47 . -rw------- 1 root root 682220 Jan 6 19:45 Weather.tbz2 -rw-r--r-- 1 root root 159744 Jan 6 18:36 26f5-oscar_vel8854-surface-currents-oscar-0.33.json.tbz2 drwxrwxr-x 12 postgres postgres 4096 Jan 4 16:01 ..
Ok, problem solved, but it was non-obvious (and still not 100% sure why). Posting here in case someone else is stuck in the same predicament.
Rebooting seemed to do nothing, fiddling with permissions and "touch"ing the file did nothing. After looking around at the /etc/incron.d configs, I took a guess that maybe how I put the in opaks was causing it not to trigger the opakhandler.
What I originally did (that didnāt apparently work): I scpāed the file to the home directory, then cpād (copied) it to ā/mnt/external/opaksā.
The āfixā that caused it to get picked up was to instead mv (move) the file from home to the ā/mnt/downloads/opaksā directory. Even though those appear to be mounted to the same place, either /mnt/external/opaks didnāt trigger the /etc/incron.d/opaks.incron task, or copying it (instead of moving it) didnāt.
Once I removed it and then moved (mv) it to ā/mnt/downloads/opaksā, it decompressed the weather app and deleted the file in just a few seconds.
The weather app finally saw fit to completely download for me as well, about two nights ago. Really glad to have it and looks great on my Win 7 laptop - not so good on the iPod Touch.
Anyway since you adjusted the priority Iāll wait a day just to see what happens. If it is still not making good progress then Iāll drop Skylark on there. Any specific feedback you guys are looking for with Skylark?
