- Suzanne Remillard (AND) and Don Henshaw (AND)
ClimDB/HydroDB is on the move. ClimDB/HydroDB (ClimHy) is a web harvester and data warehouse that provides uniform access to common daily streamflow and meteorological data through a single portal (Henshaw et al. 2006). ClimHy, which has been hosted by the Andrews LTER since 2003, is being migrated to the LTER Network Office (LNO). This migration is occurring to relieve the support and administrative burden from the Andrews LTER site and LNO welcomes hosting this key Network Information System (NIS) module. LNO hosting will improve efficiency in the eventual integration of this module into the new NIS architecture.
The timeline of migration is to have all sites using the LNO application by early 2010.The database administration will still be performed by the ClimHy administrator, Suzanne Remillard (AND), until the LNO hires the new Network Information Manager (NIM). The LNO will take full responsibility for management and curation by Spring 2010. The Andrews IM will continue to be available to provide consultation until the NIM is fully trained. The Andrews ClimHy system includes the database server, file server and web server. As of now, an identical system is established at the LNO. Significant testing has been conducted to ensure stability of the system at the LNO.
What does this mean to participating sites?
Most of the migration will be seamless to participating sites and public users, however please note the following. The Andrews ClimHy database will remain the legitimate production database for harvest, access, and metadata entry until the exact date for migrating the production database (date will be determined and announced soon; probably early February 2010). At that announced date, the LNO server will become the production ClimHy server and the Andrews ClimHy server will be disabled. In the meantime, sites can begin testing both manual and programmatic harvesting to the LNO ClimHy server.
The new LNO ClimHy website is currently operational and participating sites can initiate test data harvests to the LNO server. The following URLs are active and ready for testing:
New webpage access to ClimDB/HydroDB site at LNO:
Participant Page: http://climhy.lternet.edu/harvest/harvest.htm
Public Data Access Page: http://climhy.lternet.edu
The migration will affect participating sites that run dynamic scripts to harvest. These sites can immediately begin testing the new LNO harvest URL in their scripts. It is suggested that scripts be revised as soon as possible to allow simultaneous harvest to both servers, at least until the production server is moved from the Andrews to LNO.
The new LNO harvest URL is: http://climhy.lternet.edu/harvest.pl/harvest.pl?module=<#>&site=
where,
<#> = URL option number (1 or 2)
= Three letter LTER Site code (i.e., AND for Andrews)
The ‘last harvest’ web service allows participants to provide site, station, and parameter to retrieve the last harvested date (contact the ClimHY administrator for more information). This web service has also been migrated and can be accessed at LNO: http://climhy.lternet.edu/wambam/services/climdb_raw_handler.pl Sites should keep in mind that all access and harvests should still be directed to the Andrews production server at this time, and that use of the LNO Server is only for testing until the actual production server change date Suzanne Remillard (AND) will work with LNO on scheduling auto-harvests from the LNO server. Wade Sheldon (GCE) has modified his system to harvest USGS sites to both the Andrews and LNO servers. Participating sites have probably noticed ClimHy reports coming from both servers. Stay tuned for future announcements regarding this migration.
Reference
Henshaw, Donald L.; Sheldon, Wade M.; Remillard, Suzanne M.; Kotwica, Kyle. 2006. CLIMDB/HYDRODB: a web harvester and data warehouse approach to building a cross-site climate and hydrology database. In: Proceedings of the 7th International Conference on Hydroscience and Engineering (ICHE-2006); Philadelphia, PA. Philadelphia, PA: Drexel University, College of Engineering: [Online]. Available: http://hdl.handle.net/1860/1434