Distributed National ASAP Archive: Overview and FYO7 Tasks Monday Nov 13th

1
Distributed National ASAP ArchiveOverviewandF
YO7 TasksMonday Nov 13th
Michelle Harper Carl Halford Jeremy
Wadsack DNAA Project Coordinator Senior
Research Scientist Technology Director University
of Texas at Austin Saint Louis
University Seven Simple Machines
2
DNAA FY07 Tasks

• Monday Nov 13th
• DNAA Overview
• Scheduled and Optional Tasks for FY07
• Timeline
• Deliverables
• Status Reports
• Tuesday Nov 14th
• FY08 Development

3
Distributed National ASAP Archive (DNAA) Project
Goals

• DNAA Project Goals
• Development and maintenance of a national ASAP
  data sharing program to support proactive
  identification and analysis of safety issues at
  industry level.
• Support VSIS approved requests for querying
  national ASAP archive
• Expansion and support of industry participation
  in sharing of de-identified ASAP information

• DNAA System Requirements
• Support distributed network structure
• De-identification must ensure airline and pilot
  anonymity
• DNAA must support multiple data collection
  formats Development of DNAA Master List
• U. Texas TEM
• FAA sponsored format UTRS/IFQYASIS
• Several unique internal airline formats (6)
• DNAA Archive functionality
• Search for events and contributing factors across
  industry
• Support confirmatory and exploratory analysis
• No cost/limited impact to participating airlines

4
Airline DNAA sample network

• Airline pushes closed deidentified reports to the
  DNAA server
• DNAA server houses de-identified ASAP records.
• T1 line supports queries to be completed on DAA
  servers

5
DNAA Network InfrastructureGeneration of the
DNAA database

• De-identified information pushed to airline
  housed, NASA-provided server on weekly/monthly
  basis.
• DNAA server stores a copy of the information that
  will be available for DNAA.
• Transformation process maps fields to common DNAA
  format.
• Only information residing in the DNAA database is
  available to be queried.

Automated data load and ETL process
Airline File Format
DNAA Event Report/DNAA Central Server
6
Distributed National ASAP Archive Network - DNAA
Report
Query
Query
Query
VSIS Gate Keepers
7
DNAA FY07 Tasks

• FAA Tasks
• Sustained support of DNAA
• VSIS Working Group Studies
• Transfer of DNAA System to third party entity
• NASA Development Tasks
• Data validation issues with categorized data
• Auto classifier
• Normalization of ASAP data
• Comparisons across airports and fleets

8
DNAA FY07 Tasks

• Tasks FY07
• Sustained support of DNAA
• DNAA network and airline data feed tracking

9
DNAA FY07 Tasks

• Maintaining the DNAA Database - Airline data feed
  

• DNAA Mapping Database
• Database of airline provided data
• Pilot report info
• Event types and contributing factors
• Aircraft
• Airports

• DNAA Central Database Monitor

10
DNAA Mapping Process

• Mapping process
• 1. Identifying Sources of Airline Data
• 2. Aid airlines in creating FILE FORMAT
• 3. Aid airlines in creating automated process for
  moving FILE FORMAT to Local Archive Server
• 4. Monitoring airline automated data feed

• Mapping process
• 4. Monitoring airline automated data feed

Event Types and Contributing Factors
City Codes
ASAP Pilot Reporting Form and ERC Info.
Aircraft
11
Current Status

• DNAA database size
• Database size at end of Jan ? 10000 event
  reports/500 per month
• 4 airlines actively pushing data to the DNAA
• Comparison with ASRS ? 30K per year (pilot
  reports)
• ASRS includes commercial and GA
• Approximately 70 DNAA event reports include both
  pilots
• Goal for the DNAA to reach approximately 15000
  event reports per year
• 4 airlines pending implementation

12
DNAA FY07 Tasks

• Tasks FY07
• Sustained support of DNAA
• DNAA network and airline data feed tracking
• Optional FY07 Tasks
• Expansion of DNAA to 4 additional airlines
• UAL
• UPS
• Alaska
• ExpressJet

13
DNAA Network 07

• Tasks
• Hardware and networking completed
• ETL process
• Testing

14
DNAA Database Status
15
DNAA FY07 Tasks

• Optional FY07 Tasks
• Expansion of DNAA to 4 additional airlines
• UAL
• UPS
• Alaska
• ExpressJet
• Costs Estimates

16
DNAA FY07 Tasks

• VSIS Working Group studies
• Late Runway Change Study
• CAST Safety Metrics Study

17

• Late Runway Change Study
• 1) Occurrence of an ATC instructed runway change
• 2) Location of aircraft at time of ATC initiated
  runway change
• Segment A ATC instructed runway change 30 to 50
  nm from touchdown
• Segment B ATC instructed runway change within
  8000 to 2500 feet AFE
• Segment C ATC instructed runway change below
  1000 feet AFE
• 3) Consequences of the instructed late runway
  change
• Internal factors (Pilot Error)
• Automation Management / Configuration
• Automation configuration -FMC/CDU
• Aircraft handling/configuration/performance
  control
• Navigation / position control
• Event types
• Altitude Deviation
• Aircraft descended through assigned altitude
• Course Deviation
• Track or Heading Deviation
• VSIS WORKING GROUP STUDIES TIMELINE

18
DNAA FY07 Tasks

• VSIS Working Group studies
• Late Runway Change Study
• CAST Safety Metrics Study

19
CAST Safety Metrics Study

• Assessment of the following parameters have been
  requested for completion of the CAST Safety
  Metrics Study
• Descents Below MDA
• Altitude Busts
• Intermittent Failures of Flight Critical Systems
• Mode Confusion
• Excursions from Normal Flight
• Approach/arrival problems subcategories of off
  desired vertical path and unstable approach
• Go around
• Incursion subcategories of runway and taxiway
• Landing event subcategories of landing long,
  landing short, and hard landing
• Aircraft malfunction events Terrain proximity
  events
• Uncommanded/unintended states or loss of control

20
CAST Safety Metrics Study

• Tasks to be completed for CAST Metric Study
• Definition of scope of each requested assessment
• Development of standardized report templates for
  each parameter
• Reports to include
• Demographic descriptions of events
• Location
• Aircraft
• ATC information
• Internal issues (pilot errors)
• External issues (threats)
• GOAL Preliminary version of standard DNAA
  reports for trending ASAP data
• Format to support future information
  dissemination Benchmarking

21
DNAA FY07 Tasks

• VSIS Working Group studies
• Late Runway Change Study
• CAST Safety Metrics Study
• Optional FY07 Tasks
• Support for VSIS Working Group Studies
• DNAA Expansion of DNAA Functional Capability
• Advances to DNAA Query Tool

22
DNAA FY07 Tasks

• Optional FY07 Tasks
• Support for VSIS Working Group Studies
• Development of Safety Metric templates.
• Advances in DNAA Chart Generator. Advancements to
  the DNAA chart generator include updates to
  support standard report templates for Safety
  Metric study.
• Validation of airline provided data
• Implementation and testing of NASA auto
  classification tool. This functional development
  allows a user to adjust or add categorized fields
  to a DNAA report. This feature would enable the
  fixed fields for a given event to be edited by an
  analyst.
• Support for airline data feed.
• These updates support to regulation of airline
  data feed, identify bad data issues and alert the
  DNAA user and airline to data feed problems.
• Costs Estimates

23
DNAA FY07 Tasks

• Transfer of DNAA System to third party entity
• Networking (NASA)
• Hardware (NASA)
• Testing Software System Functionality
• Timeline

24
DNAA FY07 Deliverables and Timeline

• Deliverables
• Monthly Status Reports
• DNAA Grant Website
• End of FY07 Deliverables
• DNAA System Status Report
• DNAA System Documentation
• Users manual
• System architecture specifications
• Timeline

25
Questions?
26
Distributed National ASAP ArchiveFY08 Proposed
Tasks Tuesday Nov 14th
Michelle Harper Carl Halford Jeremy
Wadsack DNAA Project Coordinator Senior
Research Scientist Technology Director University
of Texas at Austin Saint Louis
University Seven Simple Machines
27
DNAA FY08 Research and Development

• 3 primary RD objectives starting FY08
• 1. Information dissemination
• 2. Advancement of data mining tools
• 3. Expansion of data sources in the DNAA

28
DNAA FY08 Research and Development Information
Dissemination

• Benchmarking Capability

• DNAA Master List Categorizations

• Ability for airlines to compare themselves
  against normalized standard and other airlines

29
DNAA FY08 Research and Development Information
Dissemination

• Benchmarking Capability - Requirements
• Approval of VSIS and participating airlines
• Development of design and requirements
  documentation for airline interface
• Development and testing of normalization database
  NASA
• Integration with Auto Classification tool
• Assessment of requirements for integration with
  airline network
• Development of beta system
• Testing with airline

30
DNAA FY08 Research and Development Advancement
of Data Mining Tools

• Text Analysis for data mining
• Aviation Thesaurus
• Further integration of NASA Auto Classification
  Tools

31
DNAA FY08 Research and Development Advancement
of Data Mining Tools

• Text Analysis for data mining
• Review of available off the shelf products for
  incorporating into the DNAA
• Text analysis tool to be used for
• Identify uncategorized events
• Validate auto classification results
• Integrate with scheduled Safety Metrics Reports

32
DNAA FY08 Research and Development Advancement
of Data Mining Tools

• Industry Data Dictionary and Aviation Thesaurus
• Support text mining tool for DNAA
• Support airline collection, categorization and
  analysis of ASAP data
• Work initiated by AFS 900
• DNAA Data Dictionary
• Uses as industry resource
• Based on DNAA Master List
• Supported by 9 airlines
• Interface for information dissemination

33
DNAA FY08 Research and Development Advancement
of Data Mining Tools

• Further Integration of NASA Auto Classification
  Tools
• Standardize categorizations provided by airlines
  fed into the DNAA database
• Using pilot reported narrative descriptions
  support the identification of
• Events types
• Internal factors (pilot errors)
• External factors (threats)

DNAA Auto-classification Tool
34
Auto-classification Tool

• Auto-classification Tool - Goals
• Reduce variability of airline classified ASAP
  reports
• Integration with current airline ASAP
  classification systems
• Enable access and integration of archive data
  into the DNAA
• Current ASAP data
• Archive ASAP data
• Mandatory reporting data
• NASA
• First Phase of development - May 2007
• Second Phase of development Oct 2007

35
DNAA FY08 Research and Development Expansion of
DNAA Data Sources

• Expansion of Flight Ops airline participation
• American Eagle
• AStar Airlines (cargo)
• ATA
• ComAir
• Jetblue
• Northwest Airlines
• US Airways/America West
• Expansion to additional data sources
• Maintenance

36
Questions?