The Air Quality Data Exchange AQDE

1
The Air Quality Data Exchange (AQDE)

• An exciting new project and what it means to the
  AIRNow Program

2
AQDE What is it?

• Air Quality Data Exchange pilot
• New Jersey, New York, Delaware partnership
• Designed to allow free flow of real-time air
  quality information, both state-to-state and
  state-to-AIRNow
• Uses standardized schema and EPAs National
  Environmental Information Exchange Network
  (NEIEN) and Central Data Exchange (CDX)

3
Acronym Frenzy

• XML eXtensible Markup Language
• Human and machine readable standardized language
  for transferring data
• NEIEN National Environmental Information
  Exchange Network
• A sort of intranet designed to exchange data
  between EPA and its partners
• CDX Central Data Exchange
• EPAs node on the NEIEN

4
The basic idea behind NEIEN and CDX

• An analogy
• Credit cards
• All cards have a magnetic strip with an
  agreed-upon schema for storing your info
• Stores grab that info with card readers
• It all works because the standards are used by
  everyone in the industry, plus almost every store
  plugs into the credit card processing network

5
The basic idea behind NEIEN and CDX

• NEIEN is EPAs data exchange network
• To join, you must meet the standards for
  configuration and pass data with an approved
  schema
• CDX is EPAs loading dock, where data can be
  dropped off, or loaded onto, the network

6
Why?

• Eliminates custom data flows and formats between
  States and EPA
• Provides immense opportunities for automation
• Allows data sharing between States and with any
  entity that is on the network
• Standardizes the approach

7
AQDE and AIRNow

• AQDE began as a pilot to share data between NJ,
  NY, and DE and to share with EPA via CDX
• The AQS system was the target, so their XML
  schema was chosen
• AQDE contacted AIRNow about using that same
  schema to deliver to AIRNow
• We piloted this approach last summer

8
AQDE and AIRNow

• STI reviewed the AQS schema and adopted necessary
  elements to allow for real-time transfers
• STI set up a node on the NEIEN
• A pilot transfer was completed

9
Sounds simple. It is!

• Its a simple concept with far-reaching
  implications
• Same schema for AQS and AIRNow
• Non-proprietary alternative to OBS files, XML
  based for maximum portability
• By utilizing CDX positions AIRNow to use the same
  delivery mechanism as any other EPA data flow.

10
A few remaining issues

• AIRNow and AQS
• The XML schema makes integration possible, but
  with different levels of QA different regulatory
  requirements how do we integrate the two, if we
  do?
• AIRNow Production Node
• Currently supporting the AQDE pilot, money is in
  place to move to national production, but what
  will that mean?

11
A few remaining issues

• Transition
• We cant stop supporting the old FTP and OBS file
  method overnight
• Funding
• Will these save States money, or cost them?
• Will it raise the OM costs for AIRNow?

12
A few remaining issues, but a ton of promise

• At the DMC
• Allows for automation of submission and
  auto-recovery when file transfer fails.
• Data submission via node has recovery mechanism
  built in. The success or failure of submission
  can be detected and system can be programmed to
  automatically resend.
• AIRNow system can query state or agency nodes for
  backfill data.
• Allows states to update and backfill data in
  AIRNow database
• States can update AIRNow with QCd data (before
  they may submit to AQS) and/or backfill missing
  data. This can be automated.
• Allows AIRNow system to easily recover after any
  period of downtime. AIRNow would query state
  systems for backfill data and would not require
  state staff time. This can be automated.

13
A few remaining issues, but a ton of promise

• For equipment and software vendors
• Provides a single schema and transfer mechanism
  that can be integrated into data acquisition
  platforms
• For AIRNow partners
• Allows for sharing of data between partners,
  without necessarily going through the DMC, e.g.
  AQDE

14
Next Steps

• Bring AIRNow node to production
• Market and test this new service outside of the
  AQDE pilot states
• Market the schema to equipment vendors
• Begin to explore how this may lead to
  interconnections between AQS and AIRNow