Processes of the Information Value Chain

1
(No Transcript)
2
Processes of the Information Value Chain
(after Taylor, 1975)
Organizing Grouping Classifying Formatting
Geo-referencing
Analyzing Separating Evaluating Interpreting
Synthesizing
Judging Quality Options Advantages
Disadvantages
Deciding Matching goals, Compromising Bargaining
Deciding
Examples
CIRA VIEWS
Langley IDEA
AQ Manager
WG Summary Rpt
Database tools Data wrapper View - Mediator
Transformers Image-caching
Analyst tools Animator Consoles View/Editor
CATT
Managers tools Managers consoles Tech Advisors
????? ?????
??

3
Data Flow and Processing
4
Federated Information Environment

• Data producers maintain their own workspace and
  resources (data, reports, comments).
• Part of the resources are shared by creating a
  common virtual resources.
• Web-based integration of the resources can be
  across several dimensions
• Spatial scale Local global data sharing
• Data content Combination of data generated
  internally and externally

• The main benefits of sharing are data re-use,
  data complementing and synergy.
• The goal of the system is to have the benefits of
  sharing outweigh the costs.

5
Data Flow Processing in AQ Management
Data Refining Processes Filtering, Aggregation,
Fusion
AQ Management Reports Knowledge Derived from
Data
Primary Data Diverse Providers
AQ DATA EPA Networks IMPROVE Visibility
Satellite-PM Pattern
Status and Trends
AQ Compliance
METEOROLOGY Met. Data Satellite-Transport
Forecast model
Network Assess.
Exposure Assess.
EMISSIONS National Emissions Local
Inventory Satellite Fire Locs
Tracking Progress

• AQ data arise from diverse sources, each having
  specific history, driving forces, formats,
  quality, etc.
• Data analysis, i.e. turning the raw data into
  actionable knowledge, requires combining data
  from these sources
• The three major data processing operations
  (services) are filtering, aggregation and fusion

6
Mediator-Based Integration Architecture
(Wiederhold, 1992)

• Software agents (mediators) can perform many of
  the data integration chores
• Heterogeneous sources are wrapped by translation
  software local to global language
• Mediators (web services) obtain data from
  wrappers or other mediators and pass it on
• Wrappers remove technical, while mediators
  resolve the logical heterogeneity
• The job of the mediator is to provide an answer
  to a user query (Ullman, 1997)
• In database theory sense, a mediator is a view of
  the data found in one or more sources

User Query
View
Busse et. al, 1999
Service
Service
Wrapper
Wrapper
7
Data Acquisition and Usage Value Chain
8
Interpreted and Compiled Service

• Interpreted Service
• Processes distributed
• Data flow on Internet

• Compiled Service
• Processes in the same place
• Data flow within aggregate service
• Controllers, e.g. zoom can be shared

9
Distributed Data Processing and Integration
Brokered Peer-to Peer Network
Service Oriented Architecture Users compose
reconfigurable data processing chains form
reusable services
Broker
Catalog
User Tasks Find data and services Compose
service chains Expose output
Data
Services
Peers
User-composed service chains
Control
Data
User
User
User
10
Overlay of multiple Datasets
3 D DataCube
DataView 1
Null Layer
2 D DataCube
Layer 1
Layer 2

• Each DataCube may have 0-n dimensions
• Each dimension is assigned a view

• In a view, the number of layers is the number of
  datasets
• If a DataCube does not have a data for a view, a
  Null Layer is assigned

11
Overlay of multiple Datasets
Data Access Connections
Data Render Connections
DataView 1
DataView 3

• Each DataCube may have 0-n dimensions
• Each dimension is assigned a view

• In a view, the number of layers is the number of
  datasets
• If a DataCube does not have a data for a view, a
  Null Layer is assigned

12
An Application Program Voyager Data Browser
Controls
Ports
Displays
Data Sources
App State Data
Device Drivers
Wrappers
Flow Interpreter
Core
I/O Layer
WSDL
Web Services

• The web-programs consists of a stable core and
  adoptive input/output layers
• The core maintains the state and executes the
  data selection, access and render services
• The adoptive, abstract I/O layers connects the
  core to evolving web data, flexible displays and
  to the a configurable user interface
• Wrappers encapsulate the heterogeneous external
  data sources and homogenize the access
• Device Drivers translate generic, abstract
  graphic objects to specific devices and formats
• Ports connect the internal parameters of the
  program to external controls
• WDSL web service description documents

13
DataFed Topology Mediated Peer-to-Peer Network,
MP2P
Mediated Peer-to Peer Network
Broker maintains a catalog of accessible
resources Peers find data and access instructions
in the catalog Peers get resources directly from
peer providers
Source Federal Standard 1037C
Google Example Finding Images on Network
Topology Google catalogs the images related to
Network Topology User selects an image from the
cached image catalog User visits the provider
web-page where the image resides