GCOSWCRP Working Group on Observational Data Sets For Reanalysis

1
GCOS/WCRPWorking Group onObservational Data
SetsFor Reanalysis

• Russell Vose (and many others)

2
Not a New Idea

• The requirements of future reanalysis
• GCOS Implementation Plan
• WCRP Strategic Framework 2005-2015
• The need for improved data sets
• NASA/NOAA/NSF Workshop on the Development of
  Improved Observational Data Sets for Reanalysis
  (2005)
• ECMWF/GEO Workshop on Atmospheric Reanalysis
  (2006)
• The inaccessibility of daily/subdaily data
• GCOS Implementation Plan
• Joint Scientific Committee of the WCRP (2006)

3
A Service-Oriented Group

• Our main objectives
• Review holdings of data centers worldwide to
  identify relevant data sets
• Develop a plan for the construction and
  management of reanalysis-related data sets
• A break from the past
• Each reanalysis center performs each data
  management task for each individual reanalysis
• A few respectable accomplishments
• Even though the group has only been around just
  over a year

4
Veteran Players

• R. Vose, Chair (NCDC)
• J. Bates (NCDC)
• L. van de Berg (EUMETSAT)
• M. Bosilovich (NASA)
• J. Comeaux (NCAR)
• G. Compo (ESRL)
• P. Jones (UEA)
• K. Onogi (JMA)
• P. Steinle (BOM)
• P. Thorne (UK Met Office)
• S. Uppala (ECMWF)
• J. Woollen (NCEP)
• S. Worley (NCAR)
• C. Zou (NESDIS)

5
4 Terms of Reference (TOR)

• Review data center holdings worldwide
• Develop a plan for integrated data sets
• Oversee progress of Implementing Centers
• Report regularly to AOPC and WOAP

6
TOR 1 Review Holdings

• Data centers
• NCAR and NCDC
• NCEP, ECMWF, JMA, etc.
• Environment Canada, South African Weather Service
• Data types
• In situ and remotely sensed
• Atmospheric, oceanic, terrestrial observations
• Suitable for use in future reanalyses or extremes
  studies
• Data acquisition
• Work through official channels
• Exploit personal contacts

7
TOR 2 Develop Data Sets

• Merge holdings
• Flag duplicates and assess quality
• Include feedback from past reanalyses if possible
• Develop standards for data management
• Version control
• Formats and documentation
• Identify Implementing Centers
• For each type of observation
• Update in real time
• In collaboration with operational providers

8
TOR 3/4 Track Progress

• Oversee work
• Of Implementing Centers
• Adjust plans based changes in circumstance
• Report accomplishments
• Of the group and the Implementing Centers
• To AOPC and WOAP
• 2007 report available upon request

9
(No Transcript)
10
Accomplishments

• The WG has
• Assembled dataset inventories
• Augmented existing datasets
• Developed detailed plans for improving specific
  datasets
• Leveraged heavily off of ongoing projects
• The WG hasnt
• Denoted official Implementing Centers
• Held many meetings
• The WG is taking credit here for many things
  that were already underway anyway!

11
Surface Synoptic Inventory
12
Surface Pressure Inventory

• Global
• ISD
• NCEP-NCAR BUFR archive
• National
• Australian Bureau of Meteorology
• South African Weather Service
• Miscellaneous
• Climate Database Modernization Program (U.S. and
  abroad)
• Hadley Centre (old records for key stations)
• 30 sources altogether ( )

13
Upper Air Inventory

• 11 sources from IGRA v1 (7 GTS, 4 national)
• Air Force and MIT datasets (pre-1964)
• Bronnimann acquisitions
• NCEP and ECMWF collections
• CDMP data
• Malawi, Senegal, Kenya, Mozambique, Niger, U.S.,
  Zambia
• French West African data (13 countries)
• About 75 potential sources in all at this point

14
A Few Datasets

• Integrated Surface Data Set
• Synoptic data for surface stations worldwide
• Focus on creating inventories and adding datasets
• International Surface Pressure Databank
• Subdaily pressure data for surface stations
  worldwide
• Focus on creating version 2 of this dataset
• Integrated Global Radiosonde Archive
• Twice daily data for upper air stations worldwide
• Focus on creating inventories and reformatting
  datasets

15
Surface Synoptic Data
Integrated Surface Dataset (ISD)

• Variables
• temperature
• dew point
• - pressure
• wind direction/speed
• cloud cover
• et al.

16
ISD Sources

• AFCCC Datsav3 (DSI-9956)
• About 20,000 stations
• GTS reports (post-1973)
• Over 100 keyed tape decks and other sources
• NCDC and Navy data (DSI-3280)
• About 1400 stations
• Generally 1948-present
• In 09
• Add some sources from the synoptic inventory
• Inventory NCDCs foreign data library (20
  complete)
• Get lucky (letter from WMO to PMs about subdaily
  data)

17
New Additions to ISD
18
22,000 Stations in ISD
19
ISD Network Through Time
20
Surface Pressure ISPD

• International Surface Pressure Databank
• GCOS/AOPC/OOPC Surface Pressure Working Group
  (SPWG)
• Identify, retrieve, digitize, and Q/A subdaily
  surface pressure data
• Basis for improved circulation fields and new
  reanalysis products
• ESRL 20th Century Reanalysis
• North Atlantic European 200-250 yr ACRE
  Reanalyses

21
ISPD Sources

• Global
• ISD
• NCEP-NCAR BUFR archive
• National
• Australian Bureau of Meteorology
• South African Weather Service
• Miscellaneous
• Climate Database Modernization Program (U.S. and
  abroad)
• Hadley Centre (old records for key stations)
• 33,000 stations
• 30 sources (most will be added to ISD in 09)

22
ISPD Stations in 2000
23
ISPD Network Through Time
24
Upper Air Data
Integrated Global Radiosonde Archive (IGRA)

• Variables
• pressure
• geopotential height
• temperature
• dew point depression
• wind direction/speed

25
IGRA Data Sources

• Four core GTS datasets
• 1963-1970 (NCDC)
• 1970-1972 (NCAR)
• 1973-1999 (NCEP)
• 2000-2004 (NCDC)
• Various supplements
• 1990-1993 (ABM)
• 1998-2001 (RHIMI)
• Country-specific datasets
• In 09 Add most sources from the aforementioned
  upper air inventory

26
1536 Stations in IGRA
27
IGRA Network Through Time
28
Satellite Heritage Diagram

• Part of NOAA-NCDCs Scientific Data Stewardship
  initiative
• Coordinate inventories of satellite data holdings
  with data centers
• SHD lists historical and operational platforms,
  instruments, operational periods
• Major task is linking each platform with the data
  provider

29
(No Transcript)
30
NESDIS/StAR

• Microwave Sounding Unit (MSU)
• NOAA-10 to NOAA-14
• Intercalibrated using simultaneous nadir
  overpasses
• Implemented in NCEP CFSRR and NASA MERRA
  reanalyses
• Stratospheric Sounding Unit (SSU)
• Radiative transfer model with cell pressure
  correction
• Developed to support NCEP CFSRR
• AVHRR
• Recalibrated demonstration dataset available
  later this fall
• Not yet used in any reanalysis

31
Other Satellite Activities

• Vertical Temperature Profile Radiometer (VTPR)
• NOAA-2 through NOAA-5 (1972-79)
• Used to derive atmospheric temperature soundings
• Previously used in NCEP/NCAR and ECMWF reanalyses
• Now available from NCDC
• Special Sensor Microwave/Imager (SSM/I)
• Defense Meteorological Satellite Program F-8
  through F-15
• Temperature Data Record reprocessed for
  1993-present
• Available from NCDC/CLASS

32
ICOADS

• Release 2.5 (1662-2000) by 12/2008
• Update release by 12/2009 for future reanalyses
• ICOADS will host ACRE data

33
Summary

• Group is having an impact
• Creating inventories, improving
  reanalysis-related datasets
• Some work is underway earlier than planned (e.g.,
  at NCDC)
• Several activities worth noting
• ISD, ISPD, and IGRA
• ICOADS and various satellite products
• Future reanalyses are guiding future work
• 20th Century Reanalysis (this year)
• NCEP radiosonde-era reanalysis (2010)
• Surface Input Reanalysis for Climate Applications
  (2011)
• ERA-CLIM (2013)