World Data Centers

FAGS Meeting, April 2, 2007J.B. Minster 1

World Data CentersPresented by

Christopher G. FoxActing Director, World Data Center for

Marine Geology and Geophysics, Boulder, CO


World Data Centers…

…were created nearly 50 years ago, after the IGY, to manage geophysical and solar data on a global scale

…operate under the guidance of an ICSU (International Council for Science) panel

…are supported by host nations…archive and disseminate data and

information


WDC principles

“Full and Open Access”

• “WDCs will provide data to scientists in any country free of charge or at a cost not to exceed the cost of copying and sending the requested data.”

• “WDCs operate … for the benefit of the international scientific community and provide a mechanism for international exchange of data in all disciplines related to the Earth, its environment, and the Sun.”


WDC Guiding Principles• Open to all scientists• Non-discriminatory access to data• Data exchanged free or for the cost of copying and

dissemination• Host institutions support long-term operations

– In USA - Coordinated by NAS; host institutions are NOAA, NASA, USGS, US Navy, DOE, Columbia University, University of Colorado; Similar in China and Russia.

– In Europe and Japan, institutions desiring to join the WDC system apply to ICSU through the national representatives


The Centers

• Originally were focused on physical sciences:– Solar-terrestrial, geomagnetism, oceanography, meteorology,

glaciology• Centers today are more broadly environmental:

– Soils– Climate & paleoclimate– Biodiversity & ecology– Human interactions in the environment– Land processes

• 51 centers in 12 countries


Benefits of WDC System• Current:

– Scientist-to-scientist interaction (instead of country-to-country)• Facilitates data exchanges which might not normally occur

– International coordination and cooperation in the compilation of databases

– Long-term preservation and curation of data sets

• Future:– Consistent level of capability using modern data management

techniques– Adherence to National and International standards– International (digital) network of data centers


WDC Panel, March 2007Jean-Bernard Minster, Scripps Institution of Oceanography - ChairHartmut Grassl, Max Planck Institute for Meteorology – Vice ChairDavid Clark, NOAA/NGDC –SecretaryMichael Chinnery, TreasurerTakashi Watanabe, Ibaraki University – Japan RepresentativeGennady Sobolev, Russian Academy of Sciences – Russia

RepresentativeSUN Honglie, Chinese Academy of Sciences – China

RepresentativeFerris Webster, University of Delaware – US Representative


Today’s challenges for WDCs

• Meet new scientific & societal needs– The WDCs can focus on long-term data on environmental

processes and their interaction with human systems– However, some types of data needed for this are not yet covered

by this or any other network

• Build the capacity to manage and archive scientific data throughout the world– Nearly all centers are in developed countries– In the Northern Hemisphere


Strategies to meet the challenges

• Extend the network– New centers, partner sites

• Modernize– Exploit new technology

• Ensure data stewardship– Long-term archiving, data rescue

• Improve communication and collaboration– Liaisons with key international science programs


Extend the network

• WDCs can serve as a bridge – Once bridged between East & West– Today, the challenge is to bridge between North & South– Most data are collected by scientists in developed countries

• Add new centers or partners in emerging countries– Mirror sites in Russia, England, South Africa, France, China, India– Partners sites (mirror sites that have added local content) have been

established in Kenya, Argentina– (Mirror sites are technical; partner sites involve local scientists)


WDC World-wide Connectivity

Space EnvironmentPaleoclimatologyWDC Home Pages

Space Environment

Space EnvironmentWDC Home Pages

Space Environment

Paleoclimatology

Space Environment

Paleoclimatology

Paleoclimatology

Paleoclimatology

WDC Home Pages

= “Mirror” and Partner Sites established by WDCs

PaleoclimatologySpace Environment Space Environment

Space Environment

April 2007April 2007


Modernize the System

• Technology enables WDCs to work better– There remains a technological gap between many of the WDCs– Some WDCs need hardware, software, training

• Data directory and catalogue– Help users find data

• Interoperability– Exploit new technology for storage, communication, data entry, display– Adopt and implement common standards

• Formal periodic review process (US, China, Japan, Russia, Europe) should be sustained.


Ensure data stewardship

• Manage data from new observing programs– Develop strategies to manage data from new observing systems

• Assure long-term archiving– Assure preservation of data for the next generations of scientists– A test: can data be used effectively 20 years later?– Maintain complete and accurate metadata

• Establish a process to prioritize data rescue– “At risk” data collections (old paper records, private collections,

old digital tapes, etc…)


Communication & collaboration

• Establish liaisons with major international scientific programs– GEO/GEOSS, IGBP, WCRP, IPY, eGY

• Visiting scientist programs• Strengthen sense of community among the centers

– There are major differences in the capability among centers in different parts of the world

– Improve communication between centers– Not all regions can use the Internet effectively


ICSU Priority Assessment Area for Scientific Data and Information

• Establish a Strategic Data and Information Committee

– Develop a long term integrated framework for data and information

– Establish a Scientific Data and Information Forum (SciDIF)

• Recommendations for the World Data Centers– Implementation of new data management technologies– Adaptation to new scientific data collection methods– Relevance to existing ICSU programs– Relevance to new programs including GEO/GEOSS, IPY

and eGY


Strategic Committee on Information and Data (SCID)

• Taking the report of the CSPR Assessment Panel on Scientific Data and Information as its starting point, and in the light of developments subsequent to that report: – Guide and oversee the reform of the World Data Centre (WDC)

system and Federation of Astronomical and Geophysical data analysis Services (FAGS);

– Liaise with CODATA in the development of its strategic plan; – Advise CSPR on any other actions that might be appropriate for

ICSU to consider in order to facilitate a coordinated global approach to scientific data and information, including the potential need for a Scientific Data and Information Forum (SciDIF).

http://www.icsu.org/5_abouticsu/STRUCT_Comm_Adhoc_scid.html#TOP


A look to the future• Emerging environment for international

collaboration and data exchange through GEO/GEOSS.

• GEO/GEOSS enhances the motivations originally set forth by the IGY in 1957

• Offers a unique opportunity in coming years


WDC Directors Conference Bremen, Germany, May 7-9 2007

• Attendance by WDC Directors, and many others (ICSU, GEO, CODATA, National Data Center Directors, etc.)

• Agenda updated and refined by WDC Panel meeting, included splinter group sessions on:– Data quality and accessibility (open access)– Networking (infrastructures)– WDCs and GEOSS– Support of IPY

• Closer coordination with FAGS and CODATA; Seek participation of southern hemisphere collaborators


Questions?

World Data Centers

Documents

Transcript of World Data Centers