I can't get LizardTech Express Server to start up

[mitchelljj]

I can't get LizardTech Express Server to start up after restating Apache. Even Apache will not respond. When I take out the bottom command within Apache httpd.conf which refers to Express Server:
Include "C:\LizardTech\ExpressServer6.1\ImageServer\etc\apache\mod_iserv_apache22.conf"

Then Apache starts up. I have been using Express server for months with no problems until now.

How can I repair Express Server so that it starts up again?

Also if I am not able to repair then could I back up my Spatial indexes and overviews so that I would not have to regenerate them after doing a new installation?

[rparker]

Sometimes the database gets corrupted and we are looking at ways of eliminating this issue. For now, we have to work around it and repair the database using the following command (run from the windows command line):
 
Here are some step by step instructions:
 
1. Set your error log to debug mode in the iserv-config.xml file.
2. Restart the server and check the error log to determine which catalog to fix. Look for something similar to the following couple of lines (different catalog name):
 
28/May/2009:09:25:27 [3224] [infor] loading spatial index for catalog bmng.200411.topobathy with classID {D090DD8B-3D12-4631-9787-0DC2CACDC3EA}
28/May/2009:09:25:31 [4912] [infor] ISDiskCacheMgr: going to sleep for 5 minutes
 
3. Run the spindex command from within the following folder:
 
/ExpressServer6.1/ImageServer/var/catalog-data/CATALOGNAME/
 
spindex -recover -p {D090DD8B-3D12-4631-9787-0DC2CACDC3EA}
 
I hope that helps.

[mitchelljj]

I am getting a lot of catalog listings.

How do I know that it has an error?

Should I key on "ISDiskCacheMgr: going to sleep for 5 minutes" to know that a particular catalog is erroring off?

[rparker]

Yes, that is an important line to look for in the log.

[mitchelljj]

The line above "ISDiskCacheMgr: going to sleep for 5 minutes" has the long character value between {} but I can't find it within the catalog-data folder and nearest the catalog name above is Olympics_2010_Apr08_Sea_2_Sky but it does not match the listed long character value between {}.
So do I run spindex against the Olympics_2010_Apr08_Sea_2_Sky catalog?

I have listed the section in question from my log file below with the "going to sleep for 5 minutes" line within the middle.


08/Jan/2010:16:20:55 [1468] [debug] added file://10.0.11.7/data3/GlobalView/NGA/O ... 1_P001.sid to Item cache (19)
08/Jan/2010:16:20:55 [1468] [debug] added file://10.0.11.7/data3/GlobalView/NGA/O ... P001.sid#0 to Image cache (13)
08/Jan/2010:16:20:55 [1468] [debug] RengUtils::GetDataSource(): url file:///C:/LizardTech/ExpressServer6.1/ImageServer/var/catalog-data/Olympics_2010_Apr08_Sea_2_Sky/overview.sid, dialect=, protocol=file
08/Jan/2010:16:20:55 [1468] [debug] RengUtils::GetDataSource(): got it, classID={D2622683-2411-4830-A5A0-31A84B0B5560}
08/Jan/2010:16:20:55 [704] [infor] ISDiskCacheMgr: going to sleep for 5 minutes
08/Jan/2010:16:20:55 [1468] [debug] added file:///C:/LizardTech/ExpressServer6.1/ImageServer/var/catalog-data/Olympics_2010_Apr08_Sea_2_Sky/overview.sid to Item cache (20)
08/Jan/2010:16:20:55 [1468] [debug] added file:///C:/LizardTech/ExpressServer6.1/ImageServer/var/catalog-data/Olympics_2010_Apr08_Sea_2_Sky/overview.sid#0 to Image cache (14)
08/Jan/2010:16:20:55 [1468] [debug] added file:///C:/LizardTech/ExpressServer6.1/ImageServer/var/catalog-data/Olympics_2010_Apr08_Sea_2_Sky/{D090DD8B-3D12-4631-9787-0DC2CACDC3EA}/info.sdb to Item cache (21)
08/Jan/2010:16:20:55 [1468] [infor] catalog Olympics_2010_Apr08_Sea_2_Sky registered with provider file

[rparker]

I don't see the sequence. I should have clarified better in my second post.

It should be exactly the two lines in order as listed in my first post.

[mitchelljj]

Well that is the only place within the log file that has the entry "ISDiskCacheMgr: going to sleep for 5 minutes" so I guess that it means that I don't have any corrupted database files?

Before you initially responded back to my post I was ready to back up my var\catalog-data folder and my etc\cat-cfg.xml file and reinstall Express Server and then copy back the above mentioned folder and file, but of course if the database is corrupted then that would not help any.

[rparker]

Ok, it might be a good idea to run spindex on Olympics_2010_Apr08_Sea_2_Sky

{D090DD8B-3D12-4631-9787-0DC2CACDC3EA}

Just make sure to do it from the right folder (as indicated in step three in my first post). It may be possible to make a script run spindex on all catalogs and see if that fixes the situation.

Do you have any errors in your logs?

[mitchelljj]

I run the following spindex but get errors:

C:\LizardTech\ExpressServer6.1\ImageServer\var\catalog-data\Olympics_2010_Apr08_
Sea_2_Sky>C:\LizardTech\ExpressServer6.1\ImageServer\bin\spindex.exe -recover -p
{D090DD8B-3D12-4631-9787-0DC2CACDC3EA}
[error] dberr: Unlink: C:\LizardTech\ExpressServer6.1\ImageServer\var\catalog-da
ta\Olympics_2010_Apr08_Sea_2_Sky\{D090DD8B-3D12-4631-9787-0DC2CACDC3EA}\__db.005
: Permission denied
[error] dberr: Unlink: C:\LizardTech\ExpressServer6.1\ImageServer\var\catalog-da
ta\Olympics_2010_Apr08_Sea_2_Sky\{D090DD8B-3D12-4631-9787-0DC2CACDC3EA}\__db.004
: Permission denied
[error] dberr: Unlink: C:\LizardTech\ExpressServer6.1\ImageServer\var\catalog-da
ta\Olympics_2010_Apr08_Sea_2_Sky\{D090DD8B-3D12-4631-9787-0DC2CACDC3EA}\__db.003
: Permission denied
[error] dberr: Unlink: C:\LizardTech\ExpressServer6.1\ImageServer\var\catalog-da
ta\Olympics_2010_Apr08_Sea_2_Sky\{D090DD8B-3D12-4631-9787-0DC2CACDC3EA}\__db.002
: Permission denied
[error] dberr: Unlink: C:\LizardTech\ExpressServer6.1\ImageServer\var\catalog-da
ta\Olympics_2010_Apr08_Sea_2_Sky\{D090DD8B-3D12-4631-9787-0DC2CACDC3EA}\__db.001
: Permission denied
[error] dberr: region error detected; run recovery.
[error] [-30987] opening database C:\LizardTech\ExpressServer6.1\ImageServer\var
\catalog-data\Olympics_2010_Apr08_Sea_2_Sky\{D090DD8B-3D12-4631-9787-0DC2CACDC3E
A}
[error] [-30987] m_dbReader->initialize(m_dbHome, recover, m_logWriter) (file: .
.\ltv_sdxBerkeley.cpp line: 285)
[error] [80004005] opening database for recover (pIDX->Open(ILTSpatialURLIndex::
INDEX_RECOVER))

[rparker]

I missed a step. The server must be stopped before spindex is run. Please stop Apache and try again.

[mitchelljj]

OK I successfully ran spindex and started Apache but I still could not get to apache site which is my original problem.
After starting up I looked at the err.log file and it again had one entry that had "going to sleep" in it but it was against a different catalog "Olympics_2010_Comox_Feb09". Should I also run spindex against this catalog?
I have copied the above mentioned log file lines below:

08/Jan/2010:18:02:36 [1128] [infor] loading spatial index for catalog Olympics_2010_Comox_Feb09 with classID {D090DD8B-3D12-4631-9787-0DC2CACDC3EA}
08/Jan/2010:18:02:36 [1128] [debug] RengUtils::GetDataSource(): url file://10.0.11.7/data3/GlobalView/NGA/O ... 1_P001.sid, dialect=, protocol=file
08/Jan/2010:18:02:36 [1128] [debug] RengUtils::GetDataSource(): got it, classID={D2622683-2411-4830-A5A0-31A84B0B5560}
08/Jan/2010:18:02:36 [3048] [infor] ISDiskCacheMgr: going to sleep for 5 minutes
08/Jan/2010:18:02:36 [1128] [debug] added file://10.0.11.7/data3/GlobalView/NGA/O ... 1_P001.sid to Item cache (16)
08/Jan/2010:18:02:36 [1128] [debug] added file://10.0.11.7/data3/GlobalView/NGA/O ... P001.sid#0 to Image cache (11)
08/Jan/2010:18:02:36 [1128] [debug] RengUtils::GetDataSource(): url file:///C:/LizardTech/ExpressServer6.1/ImageServer/var/catalog-data/Olympics_2010_Comox_Feb09/overview.sid, dialect=, protocol=file
08/Jan/2010:18:02:36 [1128] [debug] RengUtils::GetDataSource(): got it, classID={D2622683-2411-4830-A5A0-31A84B0B5560}
08/Jan/2010:18:02:36 [1128] [debug] added file:///C:/LizardTech/ExpressServer6.1/ImageServer/var/catalog-data/Olympics_2010_Comox_Feb09/overview.sid to Item cache (17)
08/Jan/2010:18:02:36 [1128] [debug] added file:///C:/LizardTech/ExpressServer6.1/ImageServer/var/catalog-data/Olympics_2010_Comox_Feb09/overview.sid#0 to Image cache (12)
08/Jan/2010:18:02:36 [1128] [debug] added file:///C:/LizardTech/ExpressServer6.1/ImageServer/var/catalog-data/Olympics_2010_Comox_Feb09/{D090DD8B-3D12-4631-9787-0DC2CACDC3EA}/info.sdb to Item cache (18)
08/Jan/2010:18:02:36 [1128] [infor] catalog Olympics_2010_Comox_Feb09 registered with provider file

[rparker]

Yes, I would run spindex against that catalog as well.

[mitchelljj]

After many interations of spindex express server works.

Thanks for Help!!!