Going from Node to Flow

1
Going from Node to Flow
Presented byGuy Outred
2
Introducing

• Sponsored by Mentoring States and ECOS
• Based on input from States of varying geography,
  technology and Network maturity

3
Introducing

• The intended audience for this document includes
• Partners who are yet to implement a Node
• Partners who have implemented a Node, but are
  interested in alternative approaches
• Partners looking to advance their Node
  implementation

4
Got Node?
Need Exchanges?
5
Definition

• Exchange the sharing of a specific type of
  data between two or more Partners for example,
  sharing of water quality data. This is often also
  referred to as a flow.

6
Example exchanges
7
Example exchanges
8
Example exchanges
9
Example exchanges
10
Behind the Scenes
Provider (STATE)
Requestor (EPA)

• Data Request
• Authenticate
• Perform Query

• Node Management
• Request received
• Account/Service Authorized
• Request logged

CDXNODE
AGENCYNODE

• Data Transformation
• Relational data retrieved
• XML transformation
• Schema validation

Program Database
QueryProcessor

• Node Management
• Request results logged
• XML payload returned

• Data Received
• Response logged
• Payload staged

AGENCYNODE
CDXNODE

• Data Processed
• Payload validated
• Data loaded

Program Database
11
Planning your Exchanges
12
Factors affecting exchange selection

• Priorities for data sharing with Partners
• The data management authority
• The exchanges that are currently supported
• The status of agency information systems

13
blue sky
14
Implementing an Exchange
15
Implementing an Exchange

• Compile Reference Materials
• Determine Data Services to be supported
• Map agency databases and identify potential
  issues
• Resolve Issues with Trading Partner(s)
• Prepare team

16

• Compile Reference Materials

17
Reference Materials

• Compile Reference Materials

• Documents
• Flow Configuration Document (incl. schema user
  guide)
• Step by Step Guide
• Data Exchange Template
• Example XML Instance document
• Template Trading Partner Agreement
• Technical Files
• XML Schema
• Data Services XML File

18
The Alternative

• Compile Reference Materials

• For a new exchange one must develop
• Flow Configuration Document
• Identify data services
• Explain processing required
• XML Schema
• Use XML Design guidance documentation
• Reconcile with Core Reference Model II
• Official review

19

• Compile Reference Materials

20
Implementing an Exchange

• Compile Reference Materials

• Determine Data Services to be supported
• Map agency databases and identify potential
  issues
• Resolve Issues with Trading Partner(s)
• Prepare team

21

• Map agency databases and identify potential issues

22

• Map agency databases and identify potential issues

23

• Map agency databases and identify potential issues

24
Implementing an Exchange

• Compile Reference Materials

• Determine data services to be supported
• Map agency databases and identify potential
  issues
• Resolve issues with trading Partner(s)
• Prepare team

25
Implementing an Exchange

• Develop exchange services
• Develop the data extraction process
• Modify source system(s)

26

• Develop the data extraction process

27

• Develop the data extraction process

Fully Disconnected Model
Extraction Transformation (1)
Query Processing (n)
Source System Database
Staging Database
Data transformed
IncomingQuery
Node
28

• Develop the data extraction process

Real-time Data Model
Extraction, Transformation Query Processing (n)
Source System Database
Data transformed
IncomingQuery
Node
29

• Develop the data extraction process

30
Implementing an Exchange

• Develop exchange services
• Develop the data extraction process
• Modify source system(s)

31
Implementing an Exchange

• Prepare an e.g. XML document first
• Stress test exchanges early if
• High volume, or
• Large payload
• Test with more than one partner if possible

32
Implementing an Exchange
33
Implementing an Exchange
34
Implementing an Exchange

• Trading Partner Agreement
• Unilateral
• Between partners
• Use example if available
• Use TPA Guidelines

35
Exchange Reuse?

• Exchange
• Data transformation
• XML formulation
• Data services
• Some commonality across Partners
• Some recycling is occurring

36
Network Expansion
Number if exchanges
37
Questions