Roadmap%20for%20Satellite%20Data%20in%20the%20Advanced%20Weather%20Interactive%20Processing%20System%20(AWIPS)%20GOES%20Users

1
Roadmap for Satellite Data in the Advanced
Weather Interactive Processing System (AWIPS)
GOES Users ConferenceMadison, WI

• Deirdre Jones
• NOAAs National Weather Service
• Office of Science and Technology
• Systems Engineering Center (SEC)
• November 5, 2009

2
Outline

• Challenges meeting new customer weather needs
• Architectural Vision
• AWIPS Plan to Achieve Architecture
• Next Steps
• Summary

3
Customers Need Improved Weather Services

• Speed at which decisions are made
• Demand for decision support services is
  increasing
• US industry needs the most accurate, accessible,
  timely and reliable weather data to make critical
  decisions that impact our national economy
• Aviation weather impacts were 41B in 2007
• U.S. modeling and data assimilation lags other
  nations. We must do better to give the U.S. a
  competitive advantage in the global economy
• Federal deficits and resource constraints
• Integrated observations
• More efficient R-T-O (projects, modeling)
• Every dollar counts!

4
Environmental Data Challenges

• Huge data explosion
• Rapid data assimilation requirements (e.g.,
  NextGen)people, models
• Demands on data management architecture
• Data access on-demand within resource constraints
• Integrating all observing data sources to achieve
  desired effect and outcome

5
NESDIS Archive Data Rate Projections
w/MPAR
w/GOES-S
w/GOES-R w/NPOESS C2
w/NPOESS C1
w/NPP
6
Importance of Weather Information Database (WIDB)
Weather Industry
Private Industry
Observations
Forecasting
Private Sector
Numerical Prediction Systems
Network Enabled Operations
Postprocessed Probabilistic Output
NWS Forecaster

Data Integration
Radars
WIDB Cube
Aircraft
Automated Forecast Systems
Surface
Forecast Integration
Soundings
Grids
Custom Graphic Generators
Decision Support Systems
Custom Alphanumeric Generators
Governmental Decision Making
7
Infrastructure Readiness Approach

• View requirements in larger context of all future
  programs
• Develop strategic enterprise infrastructure plan
  and roadmap for building infrastructure
  capability over next 10-15 years
• Near term tasking to complete analysis of the
  GOES-R impact on NWS architecture AWIPS, NCEP
  and NWS Telecommunications Gateway (NWSTG)
  (FY08-FY10)
• Assess other aspects of the enterprise, as well
  as other system changes (FY10)
• Select architecture for efficient access to new
  satellite data and products for forecast and
  warning operations (1QFY11)
• Initiate acquisition (FY 11-12)

8
NOAA CIO's Architectural Vision
9
NOAA Infrastructure Framework

• Consider environmental data changes in context of
  NOAAs full infrastructure and in concert with
  each other
• Service oriented enterprise focused on data and
  information
• Infrastructure services core, commodity,
  transport, and security
• Transport migration consolidate NOAAs disparate
  networks into NOAANet architecture
• Mission services monitoring and observing,
  modeling and forecasting, disseminating,
  ecosystem management, etc.
• Data architecture data description, context, and
  sharing
• Governance service level agreements, data
  management
• Dissemination Services
• To include emerging technologies and Internet
  services portals, mobile devices, and
  collaboration

10
Notional Architecture
11
AWIPS in the GOES-R EraFitting the Pieces
Together

• SEC leading effort to prepare the enterprise as
  well as planning AWIPS improvements to support
  future data
• Robust infrastructure with capacity and
  throughput for larger volume/higher resolution
  data

• Flexible software infrastructure
• Communications bandwidth -- satellite broadcast
  and terrestrial networks
• Data distribution paradigm -- push and pull

12
AWIPS II Software Re-Architecture Approach

• Perform black-box conversion
• Preserve existing functionality,
• Preserve look and feel of todays system
• Maintain functionality
• Deployed system current with deployed AWIPS
  capability (i.e., OB9)
• Use open source projects - No proprietary code
• JAVA and open source projects enable AWIPS II to
  be platform and OS independent
• No plans to move from Linux
• AWIPS II enables collaborative development
• Operating System and platform independence allows
  non-Linux based research to be easily integrated
  into AWIPS II

13
AWIPS II Software Re-Architecture Outcome

• Improved software architecture and capabilities
  to accommodate new data and services
• Services oriented architecture
• More flexible in production/delivery
• Increased access to data for decision making
• Improved RTO efficiency
• through use of AWIPS
• Development Environment
• Enables future capabilities
• (e.g. flexible data delivery,
• thin client, collaboration)

14
AWIPS SOA Architecture Logical Layered View
15
AWIPS Product Suite On NOAAPort Today
NOAAPort disseminates over one million products
(30GBytes) every day
16
GOES Data in AWIPS Today
17
Future NOAAPort Product Suite

• Environmental Satellite Product Additions
• POES AVHRR Imagery (2010)
• NPP NPOESS (From NPP, beginning 2011)
• GOES-R Series (2015)
• Currently defining process for building,
  evaluating and implementing new products in the
  AWIPS II framework
• NCEP Model Product Additions
• High Resolution Window Model (2010)
• GFS-Based DNG (2010)
• Bias-corrected SREF (2011)
• Numerous additional enhancements to NCEP
  (ongoing)
• Radar (WSR-88D) Product Additions
• Dual Polarization (2011)
• Higher Pixel Resolution (2013)

Only selected major planned additions are
shown pending bandwidth expansion dates
tentative
18
AWIPS Communications Improvements

• New paradigm for data distribution
• User readiness working group to work with users/
  customers to define product access and delivery
  reqts.

• Migrate AWIPS wide area network (WAN) to NOAAnet
• Increased reliability
• Increased bandwidth
• Enables any-to-any network topology
• Increase AWIPS SBN bandwidth to 45 Mbps (full
  transponder)
• 5 times current capacity
• Enables flexible delivery over satellite

19
AWIPS Data DeliveryPush/Pull Concept

• Robust infrastructure to support intelligent
  access (push/pull) to non-local datasets
• Key Benefits
• Mitigates impacts on SBN by addressing
  significant growth in data volumes, e.g.,
  ensembles, GOES-R, NPOESS
• Allows users to access just the data they need by
  space, time, parameter
• Enables synergy with NextGen net-enabled data
  access requirements

20
NWS Infrastructure ArchitectureImplementation
Schedule
CY 2009 2010 2011 2012 2013 2014 2015 2016
NWS GOES-R Activities Assess Impact on NWS Infrastructure Architectural Requirement Development Infrastructure Design and Development Stand up New Architecture Test and Evaluation of New Architecture
Dual Polarization Milestone GOES-R and NDEMilestones NextGen Milestones
Deployment
Oct 2015 GOES-R Launch
January 2011 NDE Distribution Build
Testing, NPP Launch
April 2013 NPOESS C1 Launch
July 2013 GOES-R Data Operations Tests
IOC
MOC
21
Summary

• NOAA is working on the enterprise infrastructure
  to accept, manipulate, and use data from new
  capabilities
• Ensure all NWS systems on track for user
  readiness
• Complete assessment
• Address in design solution
• Build toward NOAA target architecture
• Efficiencies to reduce cost needed seek out new
  technologies for computing and data integration
  architectures

22
Back-up
23
What is AWIPS?
169 separate AWIPS systems at 137 geographical
locations
AWIPS Communications
AWIPS Workstations and Servers
Service provided to 3066 US Counties 24 hrs/day,
365 days/yr.
900 Workstations (total) 1200 Servers (total)
24
NOAAPort NOAAs Satellite Broadcast Network
GOES
POES
AMC-2 Satellite
Other Environmental Satellite Products
AVHRR HIRS/AMSU
DCS
GVAR
NOAA/NWS
NCEP
Guidance Model Products
Satellite Product Generation
AWIPS NCF
TOC NWSTG
NOAAPORT Uplink Facility (NY)
Satellite imagery
NOAA/NESDIS
NOAAPORT Users Includes Many Users Inside and
Outside of NOAA
WFO/RFC Forecasts, Watches Warnings
Hydromet Sensor Products (e.g., radar, ASOS,
Profiler, River Gages)
25
NOAAPort Technical Specifications

• Product Stream Assembly AWIPS Network Control
  Facility (Silver Spring Md)
• NOAAPort Satellite SES Americom (AMC-2),
  Transponder 13C
• NOAAPort Satellite Location 101? West
• Downlink Signal C BandNetwork Capacity 10
  Mbits/sec (approximate)
• Transmission Protocol DVB/S - Digital Video
  Broadcast by Satellite
• Product Identification Headings (NOAAPort,
  WMO/AWIPS product)
• Major Product Formats GRIB, BUFR, GINI, Radar
  Level III, Text, Redbook
• Compression zlib for satellite imagery and most
  radar products GRIB2 supports JPEG2000
  compression
• There are four NOAAPort data streams or
  channels each with a unique DVB PID.
• GOES/NESDIS
• NCEP/NWSTG
• NCEP/NWSTG2
• OCONUS Imagery/Model/DCP

26
Other Satellite Data in AWIPS
27
Glossary of Terms
AWIPS Advanced Weather Interactive Processing
System CLASS Comprehensive Large Array-data
Stewardship System DMSP Defense Meteorological
Satellites Program GOES Geostationary
Operational Environmental Satellite GOES-R
Geostationary Operational Environmental Satellite
R-Series GOES-R Geostationary Operational
Environmental Satellite S-Series IMETS Incident
Meteorologists IOC Initial Operating
Capability MetOp Meteorological Operational
Satellite MPAR Multi-function Phased Array Radar
Mid Operating Capability NDE NPOESS Data
Exploitation NESDIS National Environmental
Satellite, Data, and Information Service NextGen
Next Generation Air Transportation System NEXRAD
Next-Generation Radar NPOESS National
Polar-orbiting Operational Environmental
Satellite System NPP NPOESS Preparatory
Project POES Polar Operational Environmental
Satellite R-T-O Research to Operations SBN
Satellite Broadcast Network