wviewweather.com Forum Index wviewweather.com
wview and Weather Topics
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Upgrade to 2.0.0 config problems

 
Post new topic   Reply to topic    wviewweather.com Forum Index -> wview Installation
View previous topic :: View next topic  
Author Message
kusznir



Joined: 19 Sep 2005
Posts: 11

PostPosted: Sat Dec 31, 2005 9:00 pm    Post subject: Upgrade to 2.0.0 config problems Reply with quote

Hello all:

I was running wview 1.7.8 on Gentoo, and decided to upgrade to the 2.0.0 release. So far, its been kinda rocky, but I finally have the binaries compiled and installed, and I've re-configed my installation with the wvconfig script. When I start wview and look at the logs, it seems to start, but fails to generate web pages or insert any data into my mysql db, and doesn't appear to be sending to wunderground.

Here are the log messages:
Code:

Dec 31 18:40:17 nexus wviewd[31440]: <2211851519> : radlib: wviewd started as a daemon ...
Dec 31 18:40:17 nexus wviewd[31440]: <2211851531> : wview 2.0.0 starting ...
Dec 31 18:40:17 nexus wviewd[31440]: <2211851536> : station interface: serial ...
Dec 31 18:40:17 nexus wviewd[31440]: <2211851540> : console polling interval set to 15 seconds
Dec 31 18:40:19 nexus wviewd[31440]: <2211852909> : Vantage Pro on /dev/ttyQ01e0 opened ...
Dec 31 18:40:19 nexus wviewd[31440]: <2211852913> : radMsgRouterInit: radmrouted not running!
Dec 31 18:40:19 nexus wviewd[31440]: <2211852914> : radMsgRouterInit failed!
Dec 31 18:41:16 nexus radmrouted[31461]: <2211910261> : radlib: radmrouted started as a daemon ...
Dec 31 18:41:16 nexus radmrouted[31461]: <2211910269> : started on radlib system 1, workdir /var/wview
Dec 31 18:41:16 nexus radmrouted[31461]: <2211910273> : running...
Dec 31 18:41:17 nexus wviewd[31465]: <2211911378> : radlib: wviewd started as a daemon ...
Dec 31 18:41:17 nexus wviewd[31465]: <2211911389> : wview 2.0.0 starting ...
Dec 31 18:41:17 nexus wviewd[31465]: <2211911394> : station interface: serial ...
Dec 31 18:41:17 nexus wviewd[31465]: <2211911398> : console polling interval set to 15 seconds
Dec 31 18:41:18 nexus wviewd[31465]: <2211912507> : Vantage Pro on /dev/ttyQ01e0 opened ...
Dec 31 18:41:18 nexus wviewd[31465]: <2211912539> : running...
Dec 31 18:41:18 nexus wvalarmd[31472]: <2211912632> : /etc/wview/wvalarm.conf does not exist - exiting...
Dec 31 18:41:18 nexus wviewd[31465]: <2211912666> : station location: elevation: 2430 feet
Dec 31 18:41:18 nexus wviewd[31465]: <2211912667> : station location: latitude: 35.3 N  longitude: 117.7 W
Dec 31 18:41:19 nexus wviewftpd[31477]: <2211912902> : /etc/wview/wviewftp.conf does not exist - exiting...
Dec 31 18:41:19 nexus wviewd[31465]: <2211912997> : newest archive record is: 12/31/2005 17:55
Dec 31 18:41:19 nexus wviewsshd[31478]: <2211913039> : /etc/wview/wviewssh.conf does not exist - exiting...
Dec 31 18:41:19 nexus htmlgend[31471]: <2211913082> : radlib: htmlgend started as a daemon ...
Dec 31 18:41:19 nexus htmlgend[31471]: <2211913101> : generating to /var/www/html/localhost/htdocs/weather
Dec 31 18:41:19 nexus wvcwopd[31474]: <2211913107> : radlib: wvcwopd started as a daemon ...
Dec 31 18:41:19 nexus wvcwopd[31474]: <2211913121> : CWOP: configured to submit station KE6IFK data to:
Dec 31 18:41:19 nexus wvcwopd[31474]: <2211913125> : CWOP: Primary:   socal.aprs2.net:23
Dec 31 18:41:19 nexus wvcwopd[31474]: <2211913132> : CWOP: Secondary: arizona.aprs2.net:23
Dec 31 18:41:19 nexus wvcwopd[31474]: <2211913134> : CWOP: Tertiary:  indiana.aprs2.net:23
Dec 31 18:41:19 nexus wvwunderd[31476]: <2211913141> : radlib: wvwunderd started as a daemon ...
Dec 31 18:41:19 nexus wviewsqld[31469]: <2211913149> : radlib: wviewsqld started as a daemon ...
Dec 31 18:41:19 nexus wvwunderd[31476]: <2211913174> : WUNDERGROUND: configured to submit station KCARIDGE7 data to wunderground.com
Dec 31 18:41:19 nexus wviewsqld[31469]: <2211913173> : SQLDB: basic US archiving enabled -
Dec 31 18:41:19 nexus wviewsqld[31469]: <2211913180> : SQLDB: to localhost table wviewDB.archive
Dec 31 18:41:19 nexus wviewd[31465]: <2211913415> : storing record for 12/31/2005 18:00
Dec 31 18:41:19 nexus wviewd[31465]: <2211913447> : storing record for 12/31/2005 18:05
Dec 31 18:41:19 nexus wviewd[31465]: <2211913476> : storing record for 12/31/2005 18:10
Dec 31 18:41:19 nexus wviewd[31465]: <2211913505> : storing record for 12/31/2005 18:15
Dec 31 18:41:19 nexus wviewd[31465]: <2211913536> : storing record for 12/31/2005 18:20
Dec 31 18:41:19 nexus wviewd[31465]: <2211913567> : storing record for 12/31/2005 18:25
Dec 31 18:41:19 nexus wviewd[31465]: <2211913595> : storing record for 12/31/2005 18:30
Dec 31 18:41:19 nexus wviewd[31465]: <2211913626> : storing record for 12/31/2005 18:35
Dec 31 18:41:19 nexus htmlgend[31471]: <2211913636> : running...
Dec 31 18:41:19 nexus wviewd[31465]: <2211913662> : storing record for 12/31/2005 18:40
Dec 31 18:41:21 nexus wviewd[31465]: <2211915367> : station time synchronized to: 12-31-2005 18:41:21
Dec 31 18:41:21 nexus wviewd[31465]: <2211915369> : station GMT offset synchronized to: -8 hours, 0 minutes
Dec 31 18:41:23 nexus wviewd[31465]: <2211916989> : initializing computed data values...
Dec 31 18:41:26 nexus wvwunderd[31476]: <2211920442> : running...
Dec 31 18:41:26 nexus wvcwopd[31474]: <2211920441> : running...
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920437> : received archive path /var/wview/archive from wviewd: 20051231 18:41:26
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920439> : Vantage Pro station using 5 minute archive interval...
Dec 31 18:41:26 nexus wviewsqld[31469]: <2211920454> : SQLDB: beginning initial database sync (this may take some time)...
Dec 31 18:41:26 nexus wviewsqld[31469]: <2211920456> : running...
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920491> : htmlmgrInit: 44 built-in image definitions added
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920497> : htmlmgrInit: 0 user image definitions added
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920515> : htmlmgrInit: 6 html/xml templates added
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920523> : htmlmgrInit: 31 icon definitions, 197 forecast rules found ...
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920762> : htmlGenPngDialInit: fopen failed!
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920767> : htmlmgrInit: htmlGenPngDialInit failed!
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920771> : htlmgrInit failed!
Dec 31 18:44:25 nexus wviewsqld[31469]: <2212099431> : raddatabaseTableQuery: mysql_query(): error 1054 (Unknown column 'nan' in 'field list')
Dec 31 18:44:25 nexus wviewsqld[31469]: <2212099436> : dbdatabaseInsertRecord: TableInsertRow failed!
Dec 31 18:45:05 nexus htmlgend[31471]: <2212139236> : htmlErrorState: received stimulus 2
Dec 31 18:45:10 nexus wvcwopd[31474]: <2212143947> : CWOP-sending: KE6IFK>APRS,TCPXX*,qAX,KE6IFK:@010245z3538.18N/11742.14W_254/021g025t051P001h61b10129.wview200
Dec 31 18:45:20 nexus wviewsqld[31469]: <2212154270> : raddatabaseTableQuery: mysql_query(): error 1054 (Unknown column 'nan' in 'field list')
Dec 31 18:45:20 nexus wviewsqld[31469]: <2212154274> : dbdatabaseInsertRecord: TableInsertRow failed!
Dec 31 18:50:05 nexus wviewd[31465]: <2212439069> : storing record for 12/31/2005 18:50
Dec 31 18:50:05 nexus htmlgend[31471]: <2212439607> : htmlErrorState: received stimulus 2
Dec 31 18:50:20 nexus wviewsqld[31469]: <2212454674> : raddatabaseTableQuery: mysql_query(): error 1054 (Unknown column 'nan' in 'field list')
Dec 31 18:50:20 nexus wviewsqld[31469]: <2212454679> : dbdatabaseInsertRecord: TableInsertRow failed!


Can anyone tell me what's up? It used to work with 1.7.8 (as can be seen at:http://weather.kusznir.net).

Thanks!
--Jim
Back to top
View user's profile Send private message AIM Address
mteel



Joined: 30 Jun 2005
Posts: 435
Location: Collinsville, TX

PostPosted: Sat Dec 31, 2005 9:26 pm    Post subject: Reply with quote

You might want to read the ChangeLog between 1.7.8 and 2.0.0 to see if you need to obtain any new files from the distro, etc....

In this case:
Quote:
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920762> : htmlGenPngDialInit: fopen failed!
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920767> : htmlmgrInit: htmlGenPngDialInit failed!
Dec 31 18:41:26 nexus htmlgend[31471]: <2211920771> : htlmgrInit failed!

Does root have write permissions in the path specified by IMAGE_PATH in htmlgen.conf? As the ChangeLog indicates, the dial generation was optimized by creating a dial palette during init - for some reason it can't create the palette file in IMAGE_PATH...

The next problem:
Quote:
Dec 31 18:44:25 nexus wviewsqld[31469]: <2212099431> : raddatabaseTableQuery: mysql_query(): error 1054 (Unknown column 'nan' in 'field list')
Dec 31 18:44:25 nexus wviewsqld[31469]: <2212099436> : dbdatabaseInsertRecord: TableInsertRow failed!

appears to be caused by an external modification of the archive table column properties either by you manually or through use of a database client utility. Drop the table - the new wviewsqld daemon will recreate it with proper format and store every record found in all of your WLK files. Or you can just change the name of the table in wview.conf and let it create a new table, retaining the old one.

If you read all of the ChangeLog entries since your release, the upgrade should not be "rocky" at all.

It also looks like you tried to start it the first time with your old wview start script - also addressed in the ChangeLog.

Mark
Back to top
View user's profile Send private message Send e-mail Visit poster's website
kusznir



Joined: 19 Sep 2005
Posts: 11

PostPosted: Sat Dec 31, 2005 10:06 pm    Post subject: SQL problems still Reply with quote

Hi:

The database was still the origional, untouched one created by wview 1.7.8. Reguardless, I deleted it and let wviewsqld recreate it. Even after that, and after it inserted 6,253 rows, it is now spouting the same error again:
Code:

Dec 31 19:55:20 nexus wviewsqld[31830]: <2216354128> : raddatabaseTableQuery: mysql_query(): error 1054 (Unknown column 'nan' in 'field list')
Dec 31 19:55:20 nexus wviewsqld[31830]: <2216354129> : dbdatabaseInsertRecord: TableInsertRow failed!


I did find and correct the path error in htmlgend's config (typo), and it gets farther, but still bails with errors:

Code:

Dec 31 19:59:12 nexus htmlgend[31958]: <2216586117> : radlib: htmlgend started as a daemon ...
Dec 31 19:59:12 nexus htmlgend[31958]: <2216586257> : generating to /var/www/localhost/htdocs/weather
Dec 31 19:59:12 nexus htmlgend[31958]: <2216586790> : running...
Dec 31 19:59:12 nexus htmlgend[31958]: <2216586797> : received archive path /var/wview/archive from wviewd: 20051231 19:59:12
Dec 31 19:59:12 nexus htmlgend[31958]: <2216586798> : Vantage Pro station using 5 minute archive interval...
Dec 31 19:59:12 nexus htmlgend[31958]: <2216586846> : htmlmgrInit: 44 built-in image definitions added
Dec 31 19:59:13 nexus htmlgend[31958]: <2216586890> : htmlmgrInit: 0 user image definitions added
Dec 31 19:59:13 nexus htmlgend[31958]: <2216586943> : htmlmgrInit: 6 html/xml templates added
Dec 31 19:59:13 nexus htmlgend[31958]: <2216586976> : htmlmgrInit: 31 icon definitions, 197 forecast rules found ...
Dec 31 19:59:57 nexus htmlgend[31958]: <2216631029> : noaaGenerateInit: noaa.dat getLast error!
Dec 31 19:59:57 nexus htmlgend[31958]: <2216631032> : noaaGenerateInit failed!


I read the changelog and the manual. It was actually the changelog that prompted me to upgrade, as there were some features I wanted from the newer versions (importing old records into the sql database was one of the big ones). I followed the instructions for upgrading, e.g., run install-env and re-running wviewconfig.

Unfortunately, there is no initscript that works for my distro, so I have to start/stop things by hand at the moment.

Thanks for the project!
--Jim
Back to top
View user's profile Send private message AIM Address
kusznir



Joined: 19 Sep 2005
Posts: 11

PostPosted: Sat Dec 31, 2005 10:15 pm    Post subject: More info on SQL problems Reply with quote

Hi again:

I did more DB looking and peaking and found that it didn't get past Dec 2004 data before stopping any more inserts.

I copied about 9 months of weatherlink archive files from our PC when I initially installed wview, and dec 04 is the first of them.

I moved that file (2004-12.wlk) somewhere else and restarted wviewsqld. This time it got a day and 10 hours (e.g, Jan 2, 2005 10am) before dying with the same message.

These archive files were created with Weatherlink for the PC.

--Jim
Back to top
View user's profile Send private message AIM Address
kusznir



Joined: 19 Sep 2005
Posts: 11

PostPosted: Sat Dec 31, 2005 11:12 pm    Post subject: Update Reply with quote

I managed to get my wview installation working, but I can't import the majority of my .wlk archives generated by weatherlink for pc.

I've posted a copy of one of my troublesome .wlk files at:

http://www.kusznir.net/2005-01.wlk
this file dies Jan 2 at around 10:40am with the errors previously posted.

The solution to the noaa problems invovled deleting /var/wview/noaa/noaa.dat and letting it recreate it.

--Jim
http://weather.kusznir.net
Back to top
View user's profile Send private message AIM Address
kusznir



Joined: 19 Sep 2005
Posts: 11

PostPosted: Sat Dec 31, 2005 11:14 pm    Post subject: NOAA errors again Reply with quote

Aparently I posted too soon.

My NOAA problems are back. It seems that htmld is somehow croupting the file, then entering an error state as a result.

Anyone have any ideas?

Thanks!
--Jim
Back to top
View user's profile Send private message AIM Address
mteel



Joined: 30 Jun 2005
Posts: 435
Location: Collinsville, TX

PostPosted: Sun Jan 01, 2006 12:42 am    Post subject: Reply with quote

Nothing has changed with the NOAA generation - it is exactly the same. So you have something wierd going on like multiple copies of wview daemons running, etc. The UM Troubleshooting section on inspecting your wview daemons may be helpful there...

You should create your own start/stop script - just take the one in the distro closest to gentoo (FreeBSD might actually be a good generic choice) and modify the paths for your init.d environment. Starting and stopping by hand is a recipe for straggling daemons, etc.

Did 1.7.8 read your old WLK files properly? Other than the database insertions moving to a background process, that logic did not change either. You might try to turn off the SQL storage long enough to see if it reads the WLK files OK without it enabled...

It almost sounds like you are having some disk access errors, bad sectors, etc. Too many problems with things that haven't changed at all.

Oh, and did you upgrade radlib?

Let us know what you find,
Mark
Back to top
View user's profile Send private message Send e-mail Visit poster's website
kusznir



Joined: 19 Sep 2005
Posts: 11

PostPosted: Sun Jan 01, 2006 3:14 pm    Post subject: Reply with quote

The NOAA generation problems aparently happen about half the time I kill htmlgend and restart it, and I now recall running into a similar problem with 1.7.8; I had forgotten the solution initially.

I looked at it, and found that gentoo's start-stop scripts are quite a bit different than the others, espicially their functions they use. I will work on one and send it to you when its done, but that's probably a half-day project.

I just verified that my "croupt" archive files were read fine by htmlgend, as my 365day graphs include that data. Its just wviewsqld that doesn't like them. I noticed in my sql db that the last few enteries before it dies have temperature readings in the range of -3000 (minus 3 thousand). My yearly graphs don't show any such problems.

I also found that its 4 files I have problems with: Dec '04 through Febr '05. All my other archives were properly read in by all parts of wview and added to my mysql db.

Oh, and I did upgrade radlib to 2.6.1.

Thanks for your help!
Back to top
View user's profile Send private message AIM Address
Display posts from previous:   
Post new topic   Reply to topic    wviewweather.com Forum Index -> wview Installation All times are GMT - 6 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group