SCD Research Data for Ocean Observatories Steering Committee

1
SCD Research Datafor Ocean Observatories
Steering Committee

• June 18, 2001
• Steven Worley
• Scientific Computing Division
• Data Support Section

2
Outline

• Archive Basics
• Data Services
• Three Examples

3
History

• Began in 1960s
• Leadership by Roy Jenne
• Grown for 35 years
• Virtually NO data has been lost
• Dedicated stewards and reliable MSS
• User community greatly expanded
• UCAR, Gov. Agencies, National and International
  Projects

4
People

• 9.2 FTE today
• Manager, Admin., and 7.2 general staff
• All staff are educated in meteorology or
  oceanography, MS and Bachelor degrees

5
Philosophy

• Get the required data
• Organize, check, and preserve
• Provide access
• diverse collection
• users skills, highly variable

6
Archive Collection

• 500 distinct datasets
• 14 Terabytes on the MSS
• All sizes, shapes, and formats

7
Archive Collection

• Atmospheric and Oceanic in situ Observations
• Atmospheric and Oceanic Remotely Sensed
  Observations
• Operational Weather Center Analyses
• Global Atmospheric Renalyses
• Oceanographic Reanalyses
• Atmospheric Regional Model Output
• Oceanic Model Output
• High Altitude Scatter Radar Data
• Ancillary Datasets

8
How do people find out about the archive?

• Online information system
• 1000 web pages and FTP server
• Each dataset has a web page
• Discovery metadata
• File names for MSS files
• Links to other relevant WWW sites
• Software and descriptions
• Some datasets have data online
• Some datasets have order request forms
• Other resources
• Catalogs, software libraries, project
  descriptions, etc

9
Unique Individuals Getting Data Service, 2000
10
(No Transcript)
11
Data Relevant to Ocean Research

• WODB and WOA 1998, Levitus et al.
• Other products high res. T and S, MLD, annual
  temperature and heat content anomalies 1945-1998
• SST analyses
• Reynolds et al. , weekly, monthly, climatology
• Hadley Centre, GISST, and HADISST
• Surface Forcing, air-sea interaction
• Operational weather center analyses, NCEP, ECMWF
• Reanalyses, NCEP, ECMWF (forthcoming ERA)
• Heat Budgets, e.g. Josey, Oberhuber, da Silva,
  etc
• Surface Observations
• COADS
• Surface winds scatterometers

12
Data Relevant to Ocean Research

• Special Collections
• JGOFS sites, Nutr., Chlor., PP etc
• TOGA COARE, atmosphere and ocean
• Sea Ice
• Tropical Pacific sea surface salinity, 1969-1998
• Coastal T and S time series - MEDS and Scripps
• Ocean Station Vessels, (A through Z)
• Pacific Ocean island rainfall and global precip.
  characteristics form ships.

13
Three Service Examples

• Marine Surface Observations
• COADS
• QSCAT winds NCEP Analyses
• Ocean model output
• RSMAS MICOM

14
COADS

• Co-developer and Co-PI with NOAA since 1980s
• Marine surface dataset, 1794-1997
• Includes, merchant ships, WODB, TOA, Pirata,
  drifting buoys, etc.
• (both GTS and delayed data are used)
• Funded upcoming improvements
• NOAA NCDC, COADS real time ASCII data
• Better quality control
• Collect and organize ship and buoy metadata
• Higher level products, e.g. monthly wave summaries

15
COADS

• Future data additions
• Retrospective data
• Russian R/V data (1937-1990)
• 6 million records
• U.S. Met. Journal Collection (1879-1893)
• 1.8 million records
• Modern data
• ARGO float data
• GTS real time and delayed QCed data

16
COADS

• Data Distribution
• All products from the MSS
• Absolutely up to date
• SCD distributes
• Binary and ASCII formats
• Automatic processes prepare the subsets
• 80 outside requests in 2001
• NOAA distributes
• netCDF format

17
Scatterometer winds

• ESA ERS-1 and ERS-2
• 1991-1998
• NASA NSCAT
• 1996-1997, 9-months, lost in space
• NASA QSCAT, Level 2B, 25km resolution
• July 1999, continuing
• Two retrieval method product lines
• JPL, official NASA release
• RSS (Remote Sensing Systems), KU-2000 algorithm

18
Data handling and product development

• Collaborative effort with CoRA
• Get and prepare the data (SCD)
• Product comparisons (CoRA)
• Product development (CoRA)
• Archive products and redistribute (SCD)
• Example, wind stress curl

19
NCEP Operational Analysis, 01/24/2000 1800
UTC Wind stress curl, red, - blue
20
NCEP with QSCAT overlay, Wind stress curl,
red, - blue
21
NCEP QSCAT Blend, Wind stress curl, red, -
blue, Chin et al. 1998
22

• Statistics are good
• More details www.colorado-research.com/morzel/qs
  cat.curl.miami2001.html
• 18-month time series, curl, U and V
• 6 hourly interval
• .5x.5 resolution
• available to all from the MSS
• time series will be extended
• We like to help promote leading edge science in
  this way

23
Ocean Model Output

• High resolution runs of RSMAS MICOM model
• wind forcing, two cases COADS and ECMWF
• Access for Outside users
• Annual mean fields all online, web access
• Raw data via request forms and automatic offline
  processing
• Large collections, 300 GB, and 100 GB

24
MICOM Ocean Data

• Metadata Page
• General description
• Links to online data (annual mean fields)
• Links to Authors websites
• Order request forms
• Automated process accesses the MSS files and
  create subset.
• Data, software, documentation all provided via
  FTP download by the user.

25
MICOM Ocean Data

• Help scientists preserve their archives and
  facilitate exchange with collaborators and public
  in general

26
Finale

• Traditional access
• Additional access for the future
• Community Data Portal
• Real time display, subsetting, analysis, and data
  downloads