Research Data Archives Archiving, Maintenance, Access Steven Worley, Scientific Computing Division

1
Research Data ArchivesArchiving, Maintenance,
AccessSteven Worley, Scientific Computing
Division
2
Data Archiving

• Definition Research data archive
• Meteorological and physical oceanographic data
• Built over 35 years
• 500 datasets, 25 TB
• Eight data stewards (grad. degrees in met./ocn.)

3
(No Transcript)
4
Data Maintenance

• Practices
• Track lineage - Use change control system
• Creation
• File additions, fixes, replacement
• Metadata updates
• The data and metadata remain tightly linked
• Keep user information current
• Changes trigger web page updates

5
Data Maintenance

• Concerns
• Fact Huge collections of web based
  documentation.
• Text, Images, Links
• Embedded scripting (e.g. java script )
• HOW DO WE ARCHIVE WEB SITES?
• Access content 20 years from now?
• Data in DBMSs
• Software dependent
• Not viable for long-term archive, technology trap

6
Data Access

• Discovery
• Community Data Portal (NCAR/UCAR wide)
• Standardized metadata
• Divisional Section Server
• Detailed metadata, all documentation
• Four access modes
• MSS
• Only for users with MSS connection (NCAR/UCAR)
• By individual request
• Handled by data stewards
• CDROM
• Section Data Server
• Popular data only, metadata (open to the public)

7
(No Transcript)
8
ERA-40 Data

• Basic Facts
• Global atmospheric reanalysis
• T159, 60 level, 4x/day, (? 1.1 resolution)
• 1958 ? 2002 (45 years)

9
ERA-40
10
ERA-40
Monthly Mean Air Temperature at 2m

• Odds and ends
• 2 to 3 FTEs focused on ERA-40
• SCD is ERA-40 archive backup for ECMWF
• Primary U.S. source

• NASA collaboration
• CCSP Contribution, NASA Global Reanalysis, at
  GMAO/GSFC
• Modern Era Reanalyses for Research and
  Applications (MERRA)
• We will provide input data used in ERA-40
• MERRA output at NCAR/UCAR?