EOS Direct Broadcast Products Used in Operations

1
EOS Direct Broadcast Products Used in Operations

• (Operational Weather Forecasting)

Kathleen Strabala, Jordan Gerth, Scott Bachmeier,
Liam Gumley, Allen Huang
2
Overview of Wisconsin DB Activities

• Real time data processing and distribution -
  (NWS)
• Real time direct broadcast web pages
• Support of environmental monitoring and weather
  forecasting where quality and timeliness of data
  are vital
• Software development and distribution - (IMAPP)
• IMAPP allows other users the ability to support
  their own real time data and processing systems
• Testbed for MODIS/AIRS products
• Support of our own research (total control of
  system from end to end)
• AIRS data for ABI simulations
• MODIS/AIRS combined products
• MOD07 TPW / near-infrared validations
• Remote sensing workshops
• Global outreach
• Now that we have data and products, what do we do
  with them?

3

• NASA funded International MODIS/AIRS Processing
  Package (IMAPP) - POSTER
• Builds upon our previous experience with
• ITPP (International TOVS Processing Package)
  since 1985
• IAPP (International ATOVS Processing Package)
  since 1998
• Purpose To allow DB users capability of
  producing EOS products
• IMAPP is derived from the operational EOS
  processing software developed at NASA GSFC and
  JPL, and has been modified to be compatible with
  direct broadcast data. The main differences
  between IMAPP and the operational software are
• portability,
• wherever possible, the reliance on toolkits has
  been eliminated,
• the IMAPP processing environment is greatly
  simplified,
• overpasses of arbitrary size may be processed.
• New IMAPP web page and download interface
• http//cimss.ssec.wisc.edu/imapp

4
Current IMAPP Status

• MODIS products
• cloud mask (MOD35), cloud properties (MOD06CT) -
  height, temperature, emissivity, phase
• atmospheric profiles (MOD07) T, q, tpw, total
  ozone, stability
• aerosol optical depth (MOD04)
• sea surface temperatures (Jim Davies not MOD28)
• near-infrared water vapor (Peter Albert, Ralf
  Bennartz not MOD05)
• MODIS utilities
• creating true color images tutorial
• AIRS products
• AIRS/AMSU/HSB Level 1 (with JPL)
• AIRS Level 2 profiles (both single pixel and 3x3)
• AMSR-E products RSS L1B software
• Rain rate, rain type
• Soil Moisture
• Snow Water Equivalence

5
IMAPP MODIS Level 2 v2.0 Released

• (So far, 34 different countries have obtained
  MODIS L2 v2.0)
• Improvements
• Collect 5 algorithm updates
• Repackaged to run as a series of executables
  called from one script - (SeaDAS like)
• Ancillary data automatically identified and
  fetched from IMAPP ftp site
• Ancillary data archive covers entire lifetime of
  Aqua and Terra
• IDL no longer required for HDF file generation
  (Thanks to DRL for conversion routines)
• Imaging software based on McIDAS produces quick
  look product images automatically
• Removes confusion over dependencies between
  previous versions of Level 2 releases

6
Example Image
Example IMAPP Level 2 McIDAS True Color Image
Automatically Created From South Africa
DB Pass 1 Aug 2007 0812 UTC
7
Example IMAPP Level 2 McIDAS SST Image
Automatically Created From South Africa
DB Pass 1 Aug 2007 0812 UTC
8
Example Image
Example IMAPP Level 2 NSMC True Color Image
Automatically Created From Mainland China
DB Pass 16 Sep 2007 0134 UTC
9
Example Image
Example IMAPP Level 2 NSMC Band 1 (.68 micron)
Image
Automatically Created From Mainland China
DB Pass 16 Sep 2007 0134 UTC
10
Example Image
Example IMAPP Level 2 NSMC Band 7 (2.1 micron)
Image
Automatically Created From Mainland China
DB Pass 16 Sep 2007 0134 UTC
11
Example Image
Example IMAPP Level 2 NSMC Band 26 (1.34 micron)
Image
Automatically Created From Mainland China
DB Pass 16 Sep 2007 0134 UTC
12
Example Image
Example IMAPP Level 2 NSMC Band 27 (6.7 micron)
Image
Automatically Created From Mainland China
DB Pass 16 Sep 2007 0134 UTC
13
Example Image
Example IMAPP Level 2 NSMC Band 31 (11 micron)
Image
Automatically Created From Mainland China
DB Pass 16 Sep 2007 0134 UTC
14
Example Image
Example IMAPP Level 2 NSMC Cloud Mask Image
Automatically Created From Mainland China
DB Pass 16 Sep 2007 0134 UTC
15
Example Image
Example IMAPP Level 2 NSMC Cloud Phase Image
Automatically Created From Mainland China
DB Pass 16 Sep 2007 0134 UTC
16
Example Image
Example IMAPP Level 2 NSMC CTP Image
Automatically Created From Mainland China
DB Pass 16 Sep 2007 0134 UTC
17
Example Image
Example IMAPP Level 2 NSMC SST Image
Automatically Created From Mainland China
DB Pass 16 Sep 2007 0134 UTC
18
Example Image
Example IMAPP Level 2 NSMC Water Vapor MOD07 Image
Automatically Created From Mainland China
DB Pass 16 Sep 2007 0134 UTC
19
Future IMAPP Releases

• AIRS Level 2 5.2
• MODIS Collect 6 algorithm updates?
• AMSR-E L1A, L2A updates (RSS no longer supports
  the L1B software distributed through IMAPP)
• MODIS destriping algorithm
• Reduces detector-to-detector variation (striping)
  in IR data
• Cloud Optical Thickness, Cloud Effective Radius
  (MOD06OD)
• MODIS/AIRS Collocation Software
• MODIS/AIRS combined retrievals
• DB CRAS - NWP model
• Domain centered on DB station - 48 km and 20 km
  nested grid
• Assimilates IMAPP MOD07 and MOD06CT products
• Produces standard NWP gridded fields as well as
  forecast satellite IR and WV imagery (currently
  used by US NWS)
• Output can be viewed in 3 dimensions (including
  clouds)

20
Can MODIS Data and Products be of Use to
Forecasters? Can Research Satellites be Used in
Operations?

• What makes a product useful?
• Provide environmental products that are new
  and/or better
• Provide it quickly and reliably
• Given this criteria, what do MODIS products
  provide that is new or better?
• Higher Spatial Resolution (data at 250 m and 1km,
  products 1km and 4km at nadir)
• Unique spectral bands (36 bands including cirrus,
  snow and ice, bands that allow retrieval of phase
  both day and night)
• New products (True Color)
• Available in AWIPS - NWS visualization tool
• Preparation for GOES-R many similar bands to
  MODIS
• Usefulness must be weighed against
• Limited bandwidth (until recently, 96 kbps NWS
  feed)
• Timeliness of products (overpass times
  processing times)

21
Support of US National Weather Service Forecasters

• Routine feed of UW direct broadcast products to
  Central Region Forecast Office began 30 June
  2006
• Marshall Space Flight Center (MSFC) also
  providing products to NWS using UW DB data to the
  Southern Region.
• Different delivery system

22
AWIPS D-2D

• AWIPS - Advanced Weather Interactive Processing
  System
• D2D - Display Two-Dimensions
• GUI no command line
• One-stop mechanism for gathering and viewing all
  operational weather data at USA National Weather
  Service field offices, including model data,
  satellite data, observations, lightning, local
  radar, etc.

23
AWIPS D-2D
Panes
24
Installation of Local AWIPS

• One of the only sites outside of NWS
• Familiarity with AWIPS software (Jordan Gerth)
• Allowed us to thoroughly test product insertion
  and display
• Development of MODIS software and menus for
  display of new products

25
Types of Imagery and Products

• Surface Products - Land and Marine (1 Kilometer)
• Sea Surface Temperature (SST)
• Normalized Difference Vegetation Index (NDVI)
• Land Surface Temperature (LST)
• Atmosphere (4 Kilometer)
• Total Precipitable Water (TPW)
• Cloud Phase (CTP)
• Cloud Top Temperature (CTT)
• Two sets eastern and western
• United States

26
Types of Imagery and Products

• 250 m True Color Imagery
• Red Green Blue combination
• Bands .68 ?m - Band 1, .55 ?m - Band 4, .45 ?m -
  Band 3
• 1 Kilometer Resolution
• Visible (Band 1)
• Snow/Ice (Band 7)
• Cirrus (Band 26)
• 3.7µm (Band 20)
• Water Vapor (Band 27)
• IR Window (Band 31)
• 11µm 3.7µm product (Fog Product)

27
Weaknesses

• Timeliness
• Processing and delivery takes from 30 minutes to
  1 hour. Processing takes place on Sun/Opteron
  Linux cluster
• Temporal Coverage
• Large gaps in temporal coverage
• Overpass times are not exactly the same everyday
• Less frequent observations mean more chance of
  cloud/clear interference (i.e. No Water Vapor
  retrievals because of cloud cover)
• Some bands provided by other satellites
• Since GOES visible imagery is available in a
  timely manner, there is not much benefit to using
  MODIS visible

28
Strengths

• High Resolution, Better Quality
• Depiction of small-scale features (Fog, snow/ice
  boundaries, turbulence, orographic temperature
  features)
• New Products
• 250 m True Color imagery
• NDVI at 1km
• Land Surface Temperature at 1 km
• Cloud Phase (day and night consistency)
• 1km Sea Surface Temperature
• Upwelling
• Funding to Provide Real-Time Environmental
  Monitoring Products
• Work directly with NWS Field Offices to
  determine
• Products, coverage, and display

29
Value to Forecaster

• Near-term (less than 12 hours) forecasts
• Diagnosing heavy precipitation potential
• Total Precipitable Water (TPW), Severe Weather
• Determining precipitation type
• Snow or freezing drizzle Cloud phase?
• High and low temps based upon snow/ice
  boundaries, Land Surface temperature and/or
  greenness (NDVI)
• Short-term (12 to 36 hours) forecasts
• Areas of fog formation
• Temperatures in lakeshore areas
• Open or ice covered lakes
• Fire Potential - NDVI
• Post-event analysis
• Temperature of significant convective cells
• Identification of Severe Weather events (Tornado
  Paths, flooding extent)

30
Processing Steps

• NWS forecast office installs CIMSS AWIPS MODIS
  software
• CIMSS acquires MODIS downlinked data
• Process data as quickly as possible using SeaDAS
  modisl1b, IMAPP and Direct Readout Lab software
• Cluster processing, Sun Opteron Linux, 12 CPUs
• Convert L1B and L2 products into a McIDAS
  (University of Wisconsin Visualization Tool) Area
  file
• Reformat to fit a predefined region used in AWIPS
  (eastConus, westConus) (NetCDF)

31
Processing Steps (continued)

• Zero-fill area of NetCDF where there is no subset
  of the MODIS pass
• Compress using zlib
• Inject through LDM (Local Data Manager)
• Distributed via regional offices
• Picked up by Forecast Offices via LDAD (Local
  Data Acquisition and Dissemination)

32
MODIS Direct Broadcast Ground Station
Space Science and Engineering Center (SSEC),
UW-Madison
SSEC NWS Regional Headquarters
LDM subscription at WFO
33
MODIS Direct Broadcast Ground Station
Space Science and Engineering Center (SSEC),
UW-Madison
SSEC NWS Regional Headquarters
LDM subscription at WFO
34
MODIS 1km Imagery and 4km Products in AWIPS

• Band 1 - (0.6µm) - Visible
• Band 7 - (2.1µm) - Snow/ice detection
• Band 20 - (3.7µm) - Shortwave IR
• Band 26 - (1.3µm) - Cirrus detection
• Band 27 - (6.7µm) - Water vapor
• Band 31 - (11.0µm) - IR window
• 11µm - 3.7µm - Fog/stratus product
• IMAPP products
• Total precipitable water (TPW)
• Cloud phase
• Cloud top temperature
• Sea surface temperature (SST)

35
MODIS 1km Imagery and 4km Products in AWIPS

• Band 1 - (0.6µm) - Visible
• Band 7 - (2.1µm) - Snow/ice detection
• Band 20 - (3.7µm) - Shortwave IR
• Band 26 - (1.3µm) - Cirrus detection
• Band 27 - (6.7µm) - Water vapor
• Band 31 - (11.0µm) - IR window
• 11µm - 3.7µm - Fog/stratus product
• IMAPP products
• Total precipitable water (TPW)
• Cloud phase
• Cloud top temperature
• Sea surface temperature (SST)

36
Participating Offices

• Davenport, Iowa (KDVN)
• La Crosse, Wisconsin (KARX)
• Milwaukee/Sullivan, Wisconsin (KMKX)
• Riverton, Wyoming (KRIW)
• Reno, Nevado (KRNO)
• Indianapolis, Indiana (KIND)
• Billings, Montana (KBYZ)
• Springfield, Missouri (KSGF)
• Aberdeen, South Dakota (KABR)
• Wichita, Kansas (KICT)
• Green Bay, Wisconsin (KGRB)
• Duluth, Minnesota (KDLH)
• Minneapolis, Minnesota (KMSP)
• Spokane, Washington (KSPO)
• Des Moines, Iowa (KDSM)
• Spaceflight Meteorology Group (Space Shuttle
  Weather Forecasting), Johnson Space Flight Center

37
MODIS Imagery in AWIPS
Band 1 Visible channel (0.6µm)
MODIS visible channel
GOES visible channel
38
MODIS Imagery in AWIPS
Band 1 Visible channel (0.6µm)
MODIS visible channel
GOES visible channel
39
MODIS Imagery in AWIPS
Band 1 Visible channel (0.6µm)
MODIS visible channel
GOES visible channel
40
MODIS Imagery in AWIPS
Band 1 Visible channel (0.6µm)
MODIS visible channel
GOES visible channel
41
MODIS Imagery in AWIPS
Band 1 Visible channel (0.6µm)
MODIS visible channel
GOES visible channel
42
MODIS Imagery in AWIPS
Band 1 Visible channel (0.6µm)
MODIS visible channel
GOES visible channel
43
MODIS Imagery in AWIPS
Band 1 Visible channel (0.6µm)
MODIS visible channel
GOES visible channel
44
MODIS Imagery in AWIPS
Band 1 Visible channel (0.6µm)
MODIS visible channel
GOES visible channel
45
MODIS Imagery in AWIPS
Band 7 Snow/Ice channel (2.1µm)
Snow/ice vs. supercooled water cloud
discrimination
46
MODIS Imagery in AWIPS
Band 7 Snow/Ice channel (2.1µm)
Snow/ice vs. supercooled water cloud
discrimination
47
MODIS Imagery in AWIPS
Band 7 Snow/Ice channel (2.1µm)
Snow/ice vs. supercooled water cloud
discrimination
48
MODIS Imagery in AWIPS
Band 26 Cirrus detection (1.3µm)
49
MODIS Imagery in AWIPS
Band 26 Cirrus detection (1.3µm)
50
MODIS Imagery in AWIPS
Band 20 Shortwave IR (3.7µm)
1-km MODIS
4-km GOES
Improved fire detection capability
51
MODIS Imagery in AWIPS
Band 27 Water vapor (6.7µm)
1-km MODIS
4-km GOES
Improved feature identification (jet streaks,
turbulence, etc)
52
MODIS Imagery in AWIPS
Band 31 IR window (11.0µm)
1-km MODIS
4-km GOES
Improved feature identification (overshooting
tops, enhanced-v)
53
MODIS Imagery in AWIPS
Fog/stratus product (11.0µm - 3.7µm)
1-km MODIS
4-km GOES
Improved fog/stratus detection capability
54
MODIS Imagery in AWIPS
Sea surface temperature
55
MODIS Imagery in AWIPS
Sea surface temperature
Identify areas of upwelling
56
MODIS SST product in AWIPS Supports Space Weather
Forecasters
February 10, 2008
57
MODIS Imagery in AWIPS
Cloud phase product
Can aid in the precipitation type forecast problem
58
MODIS True Color Imagery Viewer
59
MODIS True Color Imagery Viewer
60
MODIS True Color Imagery Viewer
61
MODIS True Color Imagery Viewer
62
MODIS True Color Imagery Viewer
63
MODIS True Color Imagery Viewer
12 August before heavy rains
64
MODIS True Color Imagery Viewer
25 August after heavy rains
65
Outreach and Training

• Site visits to National Weather Service Forecast
  Offices
• Sullivan, Wisconsin
• LaCrosse, Wisconsin
• Green Bay, Wisconsin
• Visit scheduled for Central Region Headquarters
  in Kansas City, Kansas in May
• Introduces products and utilities
• Questions and answers face to face

66
Forecaster Training through VISIT
NESDIS and NWS mission to accelerate the transfer
of research results based on atmospheric remote
sensing data into NWS operations using distance
education techniques.
(VISIT) Virtual Institute for Satellite
Integration Training
67
VISIT Teletraining

• Scott Bachmeier - Official NWS trainer
• 27 VISIT MODIS distance training lessons held
  November 2006 through February 2008
• Total of 46 NWS offices participating

68
(No Transcript)
69
ValidationHow do we know if the products are
useful to NWS forecasters?

• MODIS used in Area Forecast Discussions as a tool
  in decision making
• Mentioned by forecast offices 42 times
• Online surveys taken by forecasters
• Results
• 20 forecasters from KMKE, KRIW, KARX and KDVN
• 75 of forecasters rate DB MODIS AWIPS products
  as either very useful or useful
• Only 10 rated products as not useful
• Most used products are Visible, SST, Fog Product
  and Water Vapor

70
Survey Results MODIS Product Usefulness
71

• 000
• FXUS63 KMKX 311948
• AFDMKX
• AREA FORECAST DISCUSSION
• NATIONAL WEATHER SERVICE MILWAUKEE/SULLIVAN WI
• 248 PM CDT FRI AUG 31 2007
• .SHORT TERM...
• ANY REMAINING AFTERNOON CU WILL BE QUICK TO
  DISSIPATE. MAIN
• FORECAST PROBLEM WILL BE ON GROUND FOG POTENTIAL.
  MODIS
• PRECIPITABLE WATER INDICATING AROUND 0.90 INCHES
  UP FROM AROUND
• 0.53 INCHES YESTERDAY EVENING. SINCE MUCH OF THIS
  INCREASE IS IN
• THE MID LEVELS...EXPECT RADIATION CONDITIONS TO
  BE A BIT LESS
• FAVORABLE FOR FOG TONIGHT. HOWEVER DEW POINTS ARE
  A BIT
• HIGHER...AND WITH CLEAR SKIES AND LIGHT WINDS
  STILL THINK FOG WILL
• FORM MAINLY IN THE RIVER VALLEYS AND LOW AREAS.
  GFS MOS MIN TEMPS
• SEEM A BIT TOO COOL AGAIN TONIGHT.

72

• 000
• FXUS63 KMKX 272129
• AFDMKX
• AREA FORECAST DISCUSSION
• NATIONAL WEATHER SERVICE MILWAUKEE/SULLIVAN WI
• 329 PM CST WED FEB 27 2008
• .MARINE...NEARSHORE ESTIMATED TO BE 60 TO 80
  PERCENT ICE COVERED
• FROM LAST MODIS HIGH RESOLUTION VISIBLE SATELLITE
  IMAGERY FROM
• TUESDAY. SO...WILL CONTINUE TO MENTION ICE FREE
  AREAS IN FORECAST.
• WINDS AND WAVES SHOULD REACH SMALL CRAFT ADVISORY
  CONDITIONS
• THURSDAY NIGHT...WITH TIGHTENING PRESSURE
  GRADIENT AND MIXING OF 25
• TO 30 KNOT WINDS TO SURFACE. GALES TO 35 KNOTS
  ARE POSSIBLE ON
• FRIDAY.

73
Sullivan Wisconsin Weather Service Field Office
July 2006
Forecasters discussing MODIS Fog and TPW products
as displayed in AWIPS
74
Conclusions

• MODIS direct broadcast products can be of use to
  operational forecasters
• Keys to Success
• Timeliness (acquisition to end user lt 1 hour)
• Reliability
• Work closely with end users (NWS offices)
  including product selection, enhancements, etc.
• Interest by Forecast Office Science Officers
• Products must be viewable in NWS visualization
  tool (AWIPS)
• MODIS forecasting training modules developed and
  delivered through VisitView, a standard NWS
  training method
• On site visits
• Validation
• Follow up
• Jordan Gerth!

75
Contact Informationkathy.strabala_at_ssec.wisc.edu