Current Air Quality Information Ecosystem Draft for Feedback

1
Current Air Quality Information Ecosystem
(Draft for Feedback)

• AQ information includes emissions, ambient
  satellite data and model outputs
• The distributed data are produced and provided by
  agencies, mostly through portals
• Providers have different access protocols,
  formats, and information usage conditions
• This lack of interoperability causes the
  under-utilization of the rich data resources

2
Future Integrated AQ information System (Draft
for Feedback)
Data Federation Distributed, Virtual, Uniform
Data Processing Filtering, Aggregation, Fusion
Info Products Reports, Websites
DAACs
NEI
AQ Forecasting
NEISGEI
IDEA
Emission
Missions
AQ Compliance
GASP
FireInv
DataMart
AQMod
Network Assess.
AIRNow
Forecast
Status and Trends
VIEWS
WeaMod
Mediators
ASOS
GloMod

• Data are maintained by custodians and exposed
  through portals
• Mediators uniformly wrap data and provide
  processing services
• Analysts program the services to create
  application-specific products
• Responsibility is shared among data providers and
  mediator/ integrators
• ESIPFed can provide the infrastructure and tools
  for the AQ info system

3
Federated Air Quality Data System - Draft

• Text 1

Text 2
Run and click PPT Slideshow to see chart
animations
ESIP AQ Cluster 050510 Draft rhusar_at_me.wustl.edu
4
DataFed Description

• DataFed Vision
• Better air quality management and science through
  by effective use of relevant data
•  
• DataFed Goals
• Facilitate the access and flow of atmospheric
  data from provider to users
• Support the development of user-driven data
  processing value chains
• Participate in specific application projects
•  
• Approach Mediation Between Users and Data
  Providers
• DataFed assumes spontaneous, autonomous emergence
  of AQ data (a la Internet)
• Non-intrusively wraps datasets for access by web
  services
• WS-based mediators provide homogeneous data views
  e.g. geo-spatial, time...
• End-user programming of data access and
  processing through WS composition (limited)
•  
• Applications
• Building browsers and analysis tools for
  distributed monitoring data   
• Serve as data gateway for user programs web
  pages, GIS, science tools
• DataFed is currently focused on the mediation of
  air quality data

5
Anatomy of a Wrapper Service TOMS Satellite
Image Data
The daily TOMS images reside on the FTP archive,
e.g. ftp//toms.gsfc.nasa.gov/pub/eptoms/images/ae
rosol/y2000/ea000820.gif URL template
ftp//toms.gsfc.nasa.gov/pub/eptoms/images/aerosol
/yyyyy/eayymmdd.gif
src_lon_min src_lat_max
Image Description for Data Access src_image_width
502 src_image_height329 src_margin_bottom105
src_margin_left69 src_margin_right69
src_margin_top46 src_lat_min-70 src_lat_max70
src_lon_min-180 src_lon_max180
src_margin_top
src_margin_right
src_margin_left
src_img_height
Transparent colors for overlays RGB(89,140,255)
RGB(41,117,41) RGB(23,23,23) RGB(0,0,0)
src_img_width
src_lat_min src_lon_max
src_margin_bottom

• Given the URL template and the image description,
  the wrapper service can access the image for any
  day, any spatial subset using a HTTP URL or SOAP
  protocol
• Wrapper classes are available for geo-spatial
  (incl. satellite) images, SQL servers, text
  files,etc. The mediator classes are implemented
  as web services for uniform data access,
  transformation and portrayal.

6

• SeaWiFS Satellite

VIEW by Web Service Composition
SeaWiFS Satellite
Aerosol Chemical
Air Trajectory
Map Boarder
7
Datasets Used in FASTNET
Near Real Time Data Integration Delayed Data
Integration Surface Air Quality AIRNOW O3,
PM25 ASOS_STI Visibility, 300
sites METAR Visibility, 1200 sites VIEWS_OL 40
Aerosol Parameters Satellite MODIS_AOT AOT, Idea
Project GASP Reflectance, AOT TOMS Absorption
Indx, Refl. SEAW_US Reflectance, AOT Model
Output NAAPS Dust, Smoke, Sulfate,
AOT WRF Sulfate Fire Data HMS_Fire Fire
Pixels MODIS_Fire Fire Pixels Surface
Meteorology RADAR NEXTRAD SURF_MET Temp, Dewp,
Humidity SURF_WIND Wind vectors ATAD Trajector
y, VIEWS locs.

• Data are accessed from autonomous, distributed
  providers
• DataFed wrappers provide uniform geo-time
  referencing
• Tools allow space/time overlay, comparisons and
  fusion

8
A Sample of Datasets Accessible through ESIP
MediationNear Real Time ( day)
MODIS Reflectance
MODIS AOT
TOMS Index
MODIS Fire Pix
GOES AOT
GOES 1km Reflec
NEXTRAD Radar
NRL MODEL
NWS Surf Wind, Bext

• It has been demonstrated (project FASTNET) that
  these and other datasets can be accessed,
  repackaged and delivered by AIRNow through
  Consoles

9
FASTNETInter-RPO pilot project, through
NESCAUM, 2004Web-based data, tools for
community useBuilt on DataFed infra-structure,
NSF, NASAProject fate depends on sponsor, user
evaluation
10
Some of the Tools Used in FASTNET
Consoles Data from diverse sources are displayed
to create a rich context for exploration and
analysis
Viewer General purpose spatio-temporal data
browser and view editor applicable for all
DataFed datasets
CATT Combined Aerosol Trajectory Tool for the
browsing backtrajectories for specified chemical
conditions

• Data Catalog
• Data Browser
• PlumeSim, Animator
• Combined Aerosol Trajectory Tool (CATT)

11
Midwest HazeCam Image ConsoleImage Archive and
Browser
Other FASTNET Consoles
Select date and time
Set image size and time
MW HazeCam Console
Midwest HazeCam Image Browser

• Hourly Midwest HazeCam Images are archived by
  DataFed data access system
• Archived images for all cameras can be browsed
  through this console
• HazeCam URL for a day http//www.datafed.net/cons
  oles/MWH_WebCams.asp?image_width400image_height
  300datetime2005-01-31T130000
• URL for a site and day http//webapps.datafed.net
  /datasets/webcam/cincinnati/20050131-13mwhcincinna
  ti.jpg
• URLs can be embedded as links into emails,
  bookmarks, web pages, PPT and PDF files.

12
Aerosol Event Catalog Web pages

• Catalog of generic web objects pages, images,
  animations that relate to aerosol events
• Each web object is cataloged by location, time
  and aerosol type.

13
Distribution of Responsibility

• Distributed Responsibility in OpenDAP
• The data lies with the data providers
• The data access protocol lies with OPeNDAP
• Application programs with the developers (Matlab,
  .. Excel)
• Data discovery with the GCMD and NVODS
• Distributed Responsibility DataFed(??)
• The data lies with the data providers
• The wrappers and mediators with DataFed community
• Application programs with end user
• Data discovery with data service registries

14
0504142345 HMS GOES
15
0504142345 HMS GOES