NPOESS Preparatory Project NPP Archive and Distribution Segment presentation to the Committee on Ear

1
NPOESS Preparatory Project (NPP)Archive and
Distribution Segment presentation to
theCommittee on Earth Studies

• Michael Crowe
• NOAA/NESDIS
• National Climatic Data Center
• Report to the Committee on Earth Studies
• Feb 7-8, 2000

2
(No Transcript)
3
NESDIS DATA FLOW 2000
Original Analog Data
Data Rescue Processing QC
Initial Processing QC
Original Digital
Data
INPUT
Off-Line
Post Processing QC
On-Line Data Value Added Products
Near On-Line Data
Backup Archive
Re- Processing QC
Off-Site
Backup Archive
Working Archive
ARCHIVE
Standard On-the-shelf Value Added Products
Customer Access Order Processing
WWW Customer Order Interface
PROCESS
On-Line Information Data Products
Off-Line Customer Order Interface
ACCESS
OUTPUT
JOK - 01/07/2000
4
(No Transcript)
5
(No Transcript)
6
ADS Context Diagram
C3
IDPS
Application Cal Coeff.
Mission Reports
Archive and Distribution Segment
RDRs, SDRs, EDRs
Validated Ancillary Data
USERS
SDS
Formatted 1B
Climate Data
Science Cal Coeff
7
ADS Functional Flow Diagram
RDRs, SDRs, EDRs, Climate Data, Ancillary Data
Validated Data and Metadata
Ingest and Validate Data and Metadata
Service User Requests
Manage Archive
Queries and Validation
Data/Metadata
Archive
Process Orders
Processed Orders
Science and Applications Products Calibration
Coeff.
Handle Order Accounting
Generate Reports
Ship Products
Products
Mission Reports
Payments
Billing
8
ADS Functional Overview

• Data Ingest, Validation and Archive
• Archive Management
• User Interface and Customer Service
• User Product Generation
• User Product Tracking
• Report Generation

9
ADS Data Ingest Capabilities

• Data Records, associated metadata, ancillary
  data, calibration coeff., etc. from IDPS
• Science products (Level 1B, 2, 3), ancillary
  data, calibration coeff., other metadata, etc.
  from the SDS
• Reprocessed Science Products
• Applications products from the Centrals
• Daily-generated volume of data records and
  science products
• Concurrent ingest of IDPS and SDS products

10
ADS Validation Requirements

• Validate accuracy of data received as to
• Data format
• Content
• Inclusion of metadata
• Provide confirmation to IDPS and SDS
• Coordinate and provide retransmission requests
  with data providers

11
ADS-Archive Management

• Place received data into archive upon validation
• Accommodate and maintain reprocessed data
• from SDS
• Retrieve data to fulfill user requests
• Backup and restore archive
• Provide periodic archive integrity validation

12
User Interface and Customer Service

• Provide electronic, interactive interface for
  query, search and order services
• Verify payment (COFUR) prior to processing orders
• Maintain user registration and
• account information
• Provide status and account information

13
ADS-User Product Generation

• Generate user products in TBD formats based on
  validated requests
• Ship user products via electronic or physical
  means
• Fulfill user requests in a timely manner
• Provide product account information

14
Product Tracking and Report Generation

• Maintain user request and processing status
  information
• Generate mission reports, including volume of
  data received, retransmitted, and archived
• Report on number of requests
• Received
• Processed
• Shipped
• Pending
• Report on turnaround time to fulfill requests

15
Summary

• Significant Data/Product Challenges
• Delivery
• Storage/Management Volume
• Access
• Resource Challenge
• NOAA/NASA working together
• MSRR upcoming end of March
• Prototype work with EOS