Lighthouse and ORx development snapshot 2.0.002

The Lighthouse folder is here.

Thanks.

Great - - I’ll reload and report back tomorrow. Ken

/var/log space is out!
the new diag file size is more than 24 M at least 71900 lines.
Need some manual interventions… or install the new ORxPi 2.0.003 version.

Disk space:
Filesystem Size Used Available Use% Mounted on
devtmpfs 171.8M 0 171.8M 0% /dev
tmpfs 199.6M 4.0K 199.6M 0% /dev/shm
tmpfs 199.6M 296.0K 199.4M 0% /tmp
tmpfs 199.6M 52.0K 199.6M 0% /run
/dev/mmcblk0p1 75.1M 53.3M 21.8M 71% /boot
/dev/mmcblk0p2 14.1M 162.0K 12.9M 1% /mnt/persist
/dev/mmcblk0p3 33.7M 30.9M 145.0K 100% /var/log
/dev/mmcblk0p4 6.8G 589.4M 5.9G 9% /mnt/data

Are you still on 2.0.002? I made some adjustments to logging in the 2.0.003. I could also move heavy logging to /mnt/data if necessary.

Lighthouse 2.0.003 Content Problem - Continued.

I reloaded the Lighthouse with a new boot image and the new Outernet-rx-2.0.003, and installed a 16 GB SD chip instead of my hard drive. I restarted the system.

I am still having the same problem with the Library not adding new content past 48 pages, and no new Tweets. In fact the same Tweets keep reappearing, but the date changes - - time and content remain the same, and they reside on the Lighthouse’s internal storage - - not the external storage device. (I know they reside on the Lighthouse internal storage because they are there when I remove the SD chip and run Lighthouse in its bear bones mode.)

I started a paper log yesterday: 12 Dec 1137 EST 25.77 Mbits of storage used with 13 pages in Library, and only old Tweets all dated 12 Dec that resided on the Lighthouse internal storage - - no new Tweets.

12 Dec between 1137 and 1630 EST storage use increased as did page count until it topped out at the 48 page limit. Tweets never changed.

12 Dec 1630 EST 54.98 Mbits of storage used with 48 pages in Library, and only old Tweets all dated 12 Dec that resided on the Lighthouse internal storage - - no new Tweets.

13 Dec 0913 EST 74.00 Mbits of storage used with 48 pages in Library, and only old Tweets all NOW dated 13 Dec that resided on the Lighthouse internal storage - - no new Tweets.

13 Dec 0918 EST SSHed into Lighthouse and copied FSAL log (dated 13 Dec 14:18 UTC) to SD chip (sent by e mail to Branko). Then I powered down and back up the Lighthouse with same 16 GB SD chip (this naturally would restart FSAL) . It showed 75.12 Mbits of storage used NOW with 74 pages in Library, and only old Tweets all still NOW dated 13 Dec that reside on the Lighthouse internal storage - - no new Tweets. I downloaded the system log (dated 13 Dec 0927 EST) and sent that to Branko by e mail.

Bottom line appears that my Library is limited to 48 pages of data, and no new Twitter display. When I look at the system log, I see all sorts of new traffic, but after the 48 page fill-up, nothing appears. Ken

Can you tell me how you counted that? In the logs I see 72 pieces of content added to the Library.

[2015-12-12 14:47:12 (+0000)] DEBUG    Adding content 'News/Malawi/Capital Radio Malawi/Minister maintains stance of school fees hike' to archive.
[2015-12-12 15:23:08 (+0000)] DEBUG    Adding content 'News/Malawi/Capital Radio Malawi/Authorities against illegal excavation of minerals' to archive.
[2015-12-12 16:12:32 (+0000)] DEBUG    Adding content 'News/Malawi/Alliance Earth/An Open Letter To The New York Times' to archive.
[2015-12-12 16:12:33 (+0000)] DEBUG    Adding content 'News/Malawi/Alliance Earth/Botswana sells Fracking Rights in National Park' to archive.
[2015-12-12 16:12:33 (+0000)] DEBUG    Adding content 'News/Malawi/Alliance Earth/South African team may have solved solar puzzle even Google couldn
[2015-12-12 16:12:33 (+0000)] DEBUG    Adding content 'News/Malawi/Alliance Earth/Life around New Mexico
[2015-12-12 16:12:36 (+0000)] DEBUG    Adding content 'News/Malawi/Alliance Earth/Science In The Sand Gobabeb Training And Research Center' to archive.
[2015-12-12 16:12:36 (+0000)] DEBUG    Adding content 'News/Malawi/Alliance Earth/Female Anti Poaching Team in South Africa Saves Rhinos' to archive.
[2015-12-12 16:24:57 (+0000)] DEBUG    Adding content 'News/Malawi/Alliance Earth/How Renewable Energy Is Quietly Stealing A March on Coal' to archive.
[2015-12-12 16:32:20 (+0000)] DEBUG    Adding content 'News/Malawi/Alliance Earth/An Undiscovered Mountain Reveals Its Secrets' to archive.
[2015-12-12 16:33:43 (+0000)] DEBUG    Adding content 'News/Malawi/Alliance Earth/Geothermal Technology In Africa A Beacon Of Hope' to archive.
[2015-12-12 16:34:47 (+0000)] DEBUG    Adding content 'News/UNHCR/COP 21 Climate change refugees and couture' to archive.
[2015-12-12 16:41:24 (+0000)] DEBUG    Adding content 'News/UNHCR/UNHCR water project aids road safety in Kyrgyzstan' to archive.
[2015-12-12 16:41:31 (+0000)] DEBUG    Adding content 'News/UNHCR/Fast Retailing and UNHCR Announce New Agreement' to archive.
[2015-12-12 16:42:38 (+0000)] DEBUG    Adding content 'News/UNHCR/New friendships for first time Syrian cyclists in Berlin' to archive.
[2015-12-12 16:44:48 (+0000)] DEBUG    Adding content 'News/UNHCR/Wounded Syrian refugee inspires others through outreach work' to archive.
[2015-12-12 16:45:04 (+0000)] DEBUG    Adding content 'News/UNHCR/UNHCR warns of new humanitarian problems building at crossings from Greece into the Balkans' to archive.
[2015-12-12 16:47:08 (+0000)] DEBUG    Adding content 'News/UNHCR/IKEA campaign offers brighter future for Syrian refugees' to archive.
[2015-12-12 16:48:11 (+0000)] DEBUG    Adding content 'News/UNHCR/UNHCR urges CAR combatants to use Pope s visit to seek peace' to archive.
[2015-12-12 16:50:19 (+0000)] DEBUG    Adding content 'News/UNHCR/Thousands of stateless people granted nationality in Thailand' to archive.
[2015-12-12 16:50:19 (+0000)] DEBUG    Adding content 'News/UNHCR/Young Afghan uses language skills to help medics on Lesvos' to archive.
[2015-12-12 16:51:22 (+0000)] DEBUG    Adding content 'News/UNHCR/Afghan refugee defies oppression with paint' to archive.
[2015-12-12 16:52:26 (+0000)] DEBUG    Adding content 'News/UNHCR/IKEA stores around the world to raise funds to brighten lives for refugees' to archive.
[2015-12-12 16:53:30 (+0000)] DEBUG    Adding content 'News/UNHCR/Thousands of stateless people given nationality in Thailand' to archive.
[2015-12-12 16:54:40 (+0000)] DEBUG    Adding content 'News/UNHCR/Debt a growing burden for Syrian refugees in Lebanon' to archive.
[2015-12-12 16:55:43 (+0000)] DEBUG    Adding content 'News/UNHCR/Joint UNHCR IOM and UNICEF statement on new border restrictions in the Balkans' to archive.
[2015-12-12 17:38:53 (+0000)] DEBUG    Adding content 'News/Wikipedia/UK Prime Minister David Cameron calls for British air strikes against IS in Syria' to archive.
[2015-12-12 17:40:00 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Investing in the Future of Sustainable Farm Radio Programming in Malawi' to archive.
[2015-12-12 18:24:18 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Commemorating National Climate Change Week' to archive.
[2015-12-12 18:25:22 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Get to know the hands behind the popular Nkhawa Njee youth radio show' to archive.
[2015-12-12 18:26:26 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Bridging Nutrition Information Gaps Through Radio Programming and ICTs' to archive.
[2015-12-12 18:30:34 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Radio Drama for Behaviour Change The case of Nkhawa Njee mini drama' to archive.
[2015-12-12 18:38:39 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Profile Meet Dick Shumba NkhawaNjee Radio Show Host' to archive.
[2015-12-12 18:42:43 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Achieving sustainable human development through Youth engagement' to archive.
[2015-12-12 18:44:48 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Striking a Balance between Mental Health Education and Entertainment' to archive.
[2015-12-12 18:55:07 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Poll Proves National Agricultural Fair s Effectiveness' to archive.
[2015-12-12 18:56:11 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/We Are Hiring Project Officer for Our new project in Balaka' to archive.
[2015-12-12 18:57:18 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Pilirani Chimutu Mazizi wins George Atkins Communications Award' to archive.
[2015-12-12 19:01:22 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Promoting Appropriate Dietary Practices Understanding and utilizing the six food' to archive.
[2015-12-12 19:01:23 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Lilongwe ADD Manure Irrigation and Fodder Launch' to archive.
[2015-12-12 19:02:32 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Profile Meet Joy Nathu MBC Radio 2FM DJ and Producer' to archive.
[2015-12-12 19:02:32 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/12th National Agriculture Fair' to archive.
[2015-12-12 19:02:55 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/ICTs Making Radio an even more powerful communication tool' to archive.
[2015-12-12 19:07:06 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Briefing sessions with Patrons and Matrons of Nichawa Njee Youth Clubs' to archive.
[2015-12-12 19:08:09 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/New mode of interacting with the Farmers' to archive.
[2015-12-12 19:49:40 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Radio programs help farmers find more lucrative markets' to archive.
[2015-12-12 19:56:48 (+0000)] DEBUG    Adding content 'News/Malawi/Farm Radio Malawi/Radio program help dairy farmers find their way from market crisis' to archive.
[2015-12-13 14:21:08 (+0000)] DEBUG    Adding content 'News/Wikipedia/Investigators blame pilot error for AirAsia crash into Java Sea' to archive.
[2015-12-13 14:21:08 (+0000)] DEBUG    Adding content 'News/Wikipedia/Gunman attacks Planned Parenthood clinic killing three before surrendering' to archive.
[2015-12-13 14:21:08 (+0000)] DEBUG    Adding content 'News/Malawi/Mining Malawi/Press Release Publish What You Pay Malawi 
[2015-12-13 14:21:08 (+0000)] DEBUG    Adding content 'News/Malawi/Mining Malawi/Political interference foils Malawi
[2015-12-13 14:21:08 (+0000)] DEBUG    Adding content 'News/Malawi/Mining Malawi/Gone too soon Malawi loses one of the upcoming female geologists Chimwemwe Mazizi Zidana 
[2015-12-13 14:21:09 (+0000)] DEBUG    Adding content 'News/Malawi/Mining Malawi/Malawi
[2015-12-13 14:21:12 (+0000)] DEBUG    Adding content 'News/Malawi/Mining Malawi/Eye on Malawi
[2015-12-13 14:21:12 (+0000)] DEBUG    Adding content 'News/Malawi/Mining Malawi/Event Lake Malawi Under Threat 
[2015-12-13 14:21:13 (+0000)] DEBUG    Adding content 'News/Malawi/Mining Malawi/Globe scouts for buyer for Kanyika niobium 
[2015-12-13 14:21:13 (+0000)] DEBUG    Adding content 'News/Malawi/Mining Malawi/One Year Since Malawi
[2015-12-13 14:21:13 (+0000)] DEBUG    Adding content 'News/Malawi/Mining Malawi/Link Roundup for Extractive Industries in Malawi October 2015' to archive.
[2015-12-13 14:21:13 (+0000)] DEBUG    Adding content 'News/Malawi/Mining Malawi/Job Advert 2 Positions ActionAid Malawi Responsive Mining Governance Project' to archive.
[2015-12-13 14:21:24 (+0000)] DEBUG    Adding content 'News/Malawi/Alliance Earth/Coal Mining Threatens World
[2015-12-13 14:21:27 (+0000)] DEBUG    Adding content 'News/Malawi/Capital Radio Malawi/Dental health problems on the rise Blantyre DHO' to archive.
[2015-12-13 14:21:27 (+0000)] DEBUG    Adding content 'News/Malawi/Capital Radio Malawi/Directorate of road traffic overwhelmed with work' to archive.
[2015-12-13 14:21:31 (+0000)] DEBUG    Adding content 'News/Malawi/Capital Radio Malawi/Electricity project to affect 6000 in 8 districts' to archive.
[2015-12-13 14:21:31 (+0000)] DEBUG    Adding content 'News/Malawi/Capital Radio Malawi/Opposition for extended debate on termination of JCE increase of school fees' to archive.
[2015-12-13 14:21:34 (+0000)] DEBUG    Adding content 'News/Malawi/Capital Radio Malawi/Lilongwe by pass to be opened on Tuesday' to archive.
[2015-12-13 14:21:38 (+0000)] DEBUG    Adding content 'News/Malawi/Capital Radio Malawi/Parliament under pressure to explain expenditure' to archive.
[2015-12-13 14:21:38 (+0000)] DEBUG    Adding content 'News/Malawi/Capital Radio Malawi/APAM appeal for attention on matters affecting its members' to archive.
[2015-12-13 14:21:42 (+0000)] DEBUG    Adding content 'News/Malawi/Capital Radio Malawi/Economists say high interest rates likely to curtail Malawi s growth' to archive.
[2015-12-13 14:21:49 (+0000)] DEBUG    Adding content 'News/UNHCR/Ukraine Operational Update' to archive.
[2015-12-13 14:21:49 (+0000)] DEBUG    Adding content 'News/UNHCR/UNHCR concerned by violence at Greek border calls for improved security' to archive.
[2015-12-13 14:21:49 (+0000)] DEBUG    Adding content 'News/UNHCR/UNHCR urges CAR s warring sides to use Pope s visit to work for peace' to archive.
[2015-12-13 14:22:00 (+0000)] DEBUG    Adding content 'News/UNHCR/16 Days of Activism UNHCR recognizes importance of access to safe education' to archive.

My count is made by going to the Library tab:

and count the number of pages displayed - - each square group tab has 20 pages, so 2 x 20 plus the 8 on the final tab comes to my 48 page limit. Now, the above picture (which sat at 48 pages for hours, and magically climbed to 74 pages after the power up/down cycle), now (at 1126 EST) has (3 x20 + 8=78 pages (4 more than my 13 Dec 0918 EST after a restart count which presumably restarted the FSAL). Checking in again as I write this, pthe age count is growing; but the Tweets are remain the same in the display as before even thou my system log shows content (the .json files) arriving.

For example I received this Tweet from Richard about 30 minutes ago /tweets/thanerichard-1213.json, but it’s not getting put in a Twitter folder because I don’t have an @ folder for him. Here are the folders I have:

These Twitter folders have never changed in all these days. Ken

I thought I might comment on reloading the factory boot file into the Lighthouse.

In your e mail you said I needed to use a USB stick - - not an SD chip. Well I tried it, and the USB stick did nothing plugged into any USB port. I still had the same files when I restarted the Lighthouse. When I used an SD chip, I was taken thru the standard set up procedure, but still wound up having a whole bunch of recent Tweets that change date based on when I look at them, but were not new. Here, take a look

So I am still puzzled what’s wrong. Ken

For the USB stick method, the file names are different. You only need the .pkg file and it has to be named wt200.pkg.

Hi again, Branko - - the USB stick method with the single file rename to wt200.pkg did not work. I kept getting the same 2.0.003 version with its problems.

I decided to redo the SD chip method with the “boot” and “outernet-rx-2.0.001.pkg renamed to outernet-rx.pkg”. I was finally able to remove those ghost Tweets that have plagued my system and change date each day.

I am starting fresh with the older 2.0.001 Lighthouse version. I have no Files, Tweets, or Library items to start with, and am connected to the satellite with files downloading:

I’m going run in this mode for several hours to see what I get, then go thru the same SD resort process with the 2.0.003 version after you think about what’s going on with the USB stick restore question. Thanks, Ken

It won’t work if you’re already up to date. As for the problems, we haven’t fixed anything yet, so yeah, that’d be why you’re still seeing it. I’m trying to confirm it here but my Lighthouse’s tuner decided to fail (probably some electrical issue combined with dusty environment), so I’ve set up a new box.

From logs and your statments, it would appear that it’s simply a caching issue. Index is updated, and you are receiving files, so it’s somewhere between the index and display in the GUI, which would be caching.

USB stick is not a ‘restore’ method. It’s an update method. It only works when you’re going from lower to higher version. It doesn’t work for the older versions or the same version (e.g., plugging in a stick with 2.0.001 on it right now won’t do anything cause you’re already on 2.0.001, and the same would happen if you do it with 2.0.003 if you’re already on 2.0.003).