HDFEOS at NOAANESDIS

1
HDF-EOS at NOAA/NESDIS

• Huan Meng, Doug Moore, Limin Zhao, Ralph Ferraro
• NOAA / NESDIS / ORA
• http//orbit-net.nesdis.noaa.gov/arad2/MSPPS
• hmeng_at_nesdis.noaa.gov

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
2
Presentation Outline

• Microwave Surface and Precipitation
  Products
• (MSPPS) Project Background
• MSPPS System Introduction
• Product Display and Monitoring
• Lessons Learned Using HDF-EOS
• Future Plans
• Other NESDIS Projects Using HDF/HDF-EOS
• Summary

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
3
MSPPS Project Background

• Project Motivation
• NWS/NCEP interest and demand
• Team Setup
• Satellite and Instruments
• NOAA-15 or NOAA-K (May 13, 1998)
  
• AMSU-A (23.8 89.0 GHz)
• AMSU-B (89.0 190.31 GHz)
• Project Goal
• Produce near-real-time operational
  surface and precipitation
• products from AMSU-A and AMSU-B
  antenna temperatures

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
4
MSPPS System Introduction

• Day-1 System (operational,
  near-real-time)
• Product suite
• Level 1 3 data processing
  procedure
• HDF-EOS file structure
• Prototype Day-2 System (for research,
  next day)
• Combined AMSU-A and -B
  swath/grid files
• Day-2 System (testing,
  near-real-time)
• Product suite
• Level 1 3 data processing
  procedure
• HDF-EOS file structure

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
5
Uniqueness of MSPPS for NESDIS

• First Using HDF-EOS Format
• Workstation Processing
• Day-1 System Operational in 12 18
  Months

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
6
Day-1 Product Suite

• Product Surface AMSU-A
  AMSU-B
• Antenna Temperature Global ?
  ?
• Snow Cover Land ?
• Rain Rate Global ?
• Sea Ice Concentration Ocean ?
• Total Precipitable Water Ocean ?
• Cloud Liquid Water Ocean ?

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
7
MSPPS Day-1 System
NCEP (BUFR)
CIRA (HDF-EOS)
AMSU-A, -B Level-1B Data Ingestion
NCEP GDAS (GriB -gt HDF-EOS)
NCEP Rainfall (GriB)
Level-2 Product Generation
SWATH (HDF-EOS)
Product Validation Monitoring
1b (Binary)
Radiosonde (Binary)
SWATH (HDF-EOS)
GRID (HDF-EOS)
ARM (netCDF)
Level-3 Product Generation
SSM/I (Binary -gt HDF-EOS)
TRMM (HDF)
NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
8
Day-1 AMSU-A File Structures
(HDF-EOS format)
Attributes Geolocation, etc.
Antenna Temperatures Products
Geolocation, etc. Antenna Temperatures
Products
Geolocation, etc. Products
NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
9
Day-1 AMSU-B File Structures
(HDF-EOS format)

• 
  AMSU-B Swath
• AMSU-B Grid - Geographic

Attributes Geolocation, etc.
Antenna Temperatures
Geolocation, etc. Antenna Temperatures
NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
10
Prototype Day-2 System

• Combined Swath File
• Input from both AMSU-A and
  AMSU-B swaths
• Day-1 products using improved,
  physically-based,
• multispectral algorithms in day-2
• More products
• Improved resolution and
  sensitivity
• Combined Grid File - Geographic
  Projection
• Web site utilization

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
11
Day-2 Product Suite

• Product Surface AMSU-A AMSU-B
• Antenna Temperature Global ?
  ?
• Snow Cover Land ?
• Rain Rate Global ?
• Ice Water Path Global ?
• Sea Ice Concentration Ocean ?
• Total Precipitable Water Ocean ?
• Cloud Liquid Water Ocean ?
• Emissivity Land ?
• Surface/Skin Temperature Land ?
• Snow Depth Land ?
• Ocean Wind Speed Ocean ?
• Surface Wetness Land ?

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
12
MSPPS Day-2 System

AMSU-A Level-1B Data Ingestion
AMSU-A Level-2 Product Generation
Level-3 Product Generation
SWATH (HDF-EOS)
1b (Binary)
GRID (HDF-EOS)
SWATH (HDF-EOS)
AMSU-B Level-2 Product Generation
AMSU-B Level-1B Data Ingestion
AMSU-B Preliminary Level-2 Data
SWATH (HDF-EOS)
1b (Binary)
Product Validation Monitoring
NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
13
Day-2 AMSU-B File Structures
(HDF-EOS format)

• 
  AMSU-B Swath
• AMSU-B Grid - Geographic

Attributes Geolocation, etc.
Antenna Temperatures Products
Geolocation, etc. Antenna Temperatures
Products
NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
14
Product Display and Monitoring

• Display Tools
• IDL, GUI for validation with
  subsetting
• SeaDAS, view_hdf,
  LinkWinds/WebWinds, GrADS
• Web Site
• http//orbit-net.nesdis.noaa.go
  v/arad2/MSPPS
• Display and Monitoring
• Day-1 image products
• Day-1 product monitoring
• Climate images
• Day-2 image products and comparison with
  day-1

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
15
Lessons Learned Using HDF-EOS

• Advantages of HDF-EOS
• Past Challenges
• Format conversion to and from
  HDF-EOS
• Frequent version updates
• Compression method
• AUTOMERGE ? HDFE_NOMERGE
• Skipping Huffman ?
  gzip
• Continuing Problems
• Array size, array number?
• Writing to an existing swath

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
16
Future Plans

• NOAA-16 or NOAA-L
• Launch date Sept. 20, 2000
• Instruments AMSU-A and AMSU-B
• Operational Day-2 System
• NOAA-16 product system
• System delivery Dec. 2000
• Validation of Day-2 Products
• Launch of DMSP SSMIS
• Launch date Dec. 2000

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
17
Other NESDIS Projects Using HDF/HDF-EOS

• Atmosphere Infrared Sounder (AIRS)
  Project
• EOS_AQUA, July 2001
• Input (simulated) level 1b
  data in HDF-EOS format from JPL
• Output desired fields in HDF
  format to NCEP within 3 hrs
• Unified Validation Project
• Group 1
• Input NCEP observation
  data in BUFR to HDF format
• Operational, next day
• Group 2
• Input binary observation
  data and convert to HDF-EOS format
• Validation of AIRS,
  SSM/I, SSMIS, and IPO products

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS
18
Summary

• HDF-EOS as Standard Output Format for
  MSPPS
• Increased Utilization of HDF-EOS at
  NESDIS
• Advantages of HDF-EOS Application
• Remaining Challenges

NOAA / NESDIS / ORA
http// orbit-net.nesdis.noaa.gov/arad2/MSPPS