UCARNCAR distinction

1

• UCAR/NCAR distinction
• CISL/SCD rolls
• MSS and RDA
• Other Org. Elements with significant data
• Roll of CDP

2
Research Data Archives at NCAR

• RDA, a continually evolving data resource
• Contents are improved and extended
• Metadata is developed to improve discovery
• Access methods are many and expanding
• Now Web, FTP, NCAR MSS, writable media
• Future via CDP and network servers (e.g. GDS,
  OPeNDAP, etc)

3
RDA definition

• Collection of reference datasets used in
  atmospheric and related sciences
• Over 600 datasets currently archived
• 10-20 new datasets added annually
• The RDA is maintained by 9 staff
• First established about 40 years ago
• All data on the MSS
• 548K files
• 100.5 TB

4
RDA Content

• Many categories of data
• Observations
• Model Output
• NWP
• Reanalyses
• Climatology Data
• Long-term SST analyses
• Monthly summary of the day station data
• Satellite derived datasets
• Global topography and ocean depth
• Station Libraries
• Much more .

5
RDA Observations

• Observations
• Conventional meteorology and oceanography
• Surface
• Global ocean from ships and buoys (ICOADS)
• Global meteorology stations
• Gridded ocean and station obs.
• Profiles
• Global ocean hydrography
• Global upper air measurements

6
RDA Model Output

• Model Output
• Operational Model Output
• NCEP Global
• NCEP Regional North American
• ECMWF Global
• Reanalysis Projects
• NCEP Global Reanalysis I II
• NCEP Regional North American
• ECMWF Global ERA-40

7
Eta and NARR domains
8
Satellite data examples

• GPCP Combined Precipitation Data, 1979-2005
• CPC Merged Analysis of Precipitation (CMAP),
  1979-2004
• -----------------------------------------------
• NESS Visual and Infrared Brightness Analyses
  SRVIS and SRIR
• Lucas and Waliser Satellite ECT-Corrected Daily,
  Pentad and Monthly Global OLR Datasets
• -------------------------------
• International Satellite Cloud Climate Project
  (ISCCP)
• Gridded products from NASA team, many versions
• GOES images (visible infrared) from CSU
  collaborations
• -------------------------------
• ESA ERS-1 and ERS-2 Scatterometer Ocean Surface
  Winds
• NSCAT Scatterometer Ocean Winds
• ADEOS-II Scatterometer Winds
• SeaWinds QuickSCAT Scatterometer Ocean Winds (JPL
  RSS)
• QSCAT/NCEP Blended Ocean Winds from CoRA

9
RDA Metadata

• All datasets
• Described with individual web pages
• Assigned data consultant
• Catalogued in UCAR Community Data Portal (CDP)
  via standard metadata

10
Data Users Functional Diagram for RDA Access
MSS All RDA data
RDA Server Some data All Metadata
CDP Standardized Metadata
NCAR User
Internet User
11
Data Users Functional Diagram for RDA Access
MSS All RDA data
RDA Server Some data All Metadata
CDP Standardized Metadata
NCAR User
Internet User
metadata
12
Data Users Functional Diagram for RDA Access
MSS All RDA data
RDA Server Some data All Metadata
CDP Standardized Metadata
NCAR User
Internet User
metadata
data
13
Data Users Functional Diagram for RDA Access
MSS All RDA data
RDA Server Some data All Metadata
CDP Standardized Metadata
NCAR User
Internet User
metadata
data
future data
14
Operational Function Diagram for RDA
RDA Database
RDA Server Some data All Metadata
MSS All RDA data
SAN
CDP Standardized Metadata
Data Ingest
15
Operational Function Diagram for RDA
RDA Database Integrity Monitor
RDA Server Some data All Metadata
MSS All RDA data
SAN Top Collections
CDP Standardized Metadata
Data Ingest Network Media
Metadata
16
Operational Function Diagram for RDA
RDA Database Integrity Monitor
RDA Server Some data All Metadata
MSS All RDA data
SAN Top Collections
CDP Standardized Metadata
Data Ingest Network Media
Metadata
Data
17
Operational Function Diagram for RDA
RDA Database Integrity Monitor
RDA Server Some data Metadata
MSS All RDA data
SAN Top Collections
CDP Metadata Data
Data Ingest Network Media
Metadata
Data
Future Data
18
Key Case ERA-40

• 35 TB collection, 30 distinct product lines
• Added about 10 products (computed in SCD)
• Support Climate Modeling T85 Guassian grids to
  match NCAR CCSM
• Metrics for 2004

• Web FTP MSS in Data Amount
• Over 20 TB delivered
• 28K versus 13K files, RDA Server - MSS