[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: FW: Catalog generator crawling remote OPenDAP/DODS servers - thank you!!

Hi Bas,

Bas Retsios wrote:

Hello Ethan,
Thank you for your suggestions!! For now they have helped me sufficiently so that I can continue on my own for a while. 
Great.
I have one important point to add (because it took me a while to find it): To achieve the "recursive crawling" that I needed, I had to make sure that "StandardCatalogBuilder" is called with a "new BooleanCatalogRefExpander(expandAll = true)". I did notice that StandardCatalogBuilder was called from two places (DirectoryScanner and DatasetScanCatalogBuilder) but the existing code and test calls had expandAll = false.
Yes, sorry about that, the documentation is a bit sketchy. I've added that to my documentation list.
We don't do any recursive crawling in the TDS (users end up stepping through one collection level at a time) and, as you say, it looks like all our tests are for single level catalogs. I believe that some of our code uses DirectoryScanner to build multilevel catalogs. So, hopefully you won't run into any bugs in the building of multilevel catalogs. Let me know if you do. 

Ethan

--
Ethan R. Davis                                Telephone: (303) 497-8155
Software Engineer                             Fax:       (303) 497-8690
UCAR Unidata Program Center                   E-mail:    address@hidden
P.O. Box 3000
Boulder, CO  80307-3000                       http://www.unidata.ucar.edu/
---------------------------------------------------------------------------