Joint Test and Evaluation Methodology JTEM JT

1
Joint Test and Evaluation Methodology
(JTEM)JTE Overview

• 9 May 2007
• Colonel Eileen Bjorkman
• Joint Test Director
• [phone]
• eileen.bjorkman_at_jte.osd.mil

2
Overview

• Background/Problem Statement
• Capability Test Methodology
• Test Concept
• Current Status
• Products

Unclassified
3
Background Testing in a Joint Environment Roadmap
Transformation Planning Guidance
Strategic Planning Guidance
Testing in a Joint Environment Roadmap

• Joint concept-centric
• approach for capability
• development
• Integrated architectures
• define parameters of
• joint capabilities
• Need to test capabilities
• and architectures in a
• realistic joint
• environment

• Need realistic TE in a
• joint operational context
• Directed DOTE to
• develop a roadmap to
• identify changes
• necessary to ensure
• TE is conducted in a
• joint environment to
• enhance fielding of
• joint capabilities

• Build Joint Mission
• Environment from
• mission requirements
• defined by JCIDS
• Required for entire
• acquisition process, not
• additional test
• Defines infrastructure
• required
• -- Network connectivity
• -- Service environments
• -- Program-specific

Signed April 2003
Signed March 2004
Recognized need for TE Transformation
Signed November 2004
Ref JTEM JFS Directive of 3-11-05
JCIDS - Joint Capability Integration and
Development System JFS - Joint Feasibility Study
4
Background JTEM Role in the Roadmap
Implementation
Phases of Customers Event Operations
Strategy
Event
Infrastructure
Event
Analysis/
Strategy
Event
Infrastructure
Event
Analysis/
Strategy
Event
Infrastructure
Event
Analysis/
Definition
Planning
Support
Execution
Reporting
Definition
Planning
Support
Execution
Reporting
Definition
Planning
Support
Execution
Reporting
Interactive Customer Support Services
Interactive Customer Support Services
Interactive Customer Support Services
JMETC
Policy WG
Infrastructure
Infrastructure
Infrastructure
Infrastructure
Methods
Methods
Methods
Methods
Processes
Processes
Processes
Processes
Policy
Policy
Policy
Policy
JTEM
ATL
DOTE
DOTE
Core Enablers
Core Enablers
Core Enablers
Methods Processes Working Group Issues
delineated in Implementation Plan form basis for
JTEM methodology
JMETC Joint Mission Environment Test Capability
Unclassified
5
BackgroundJTEM Problem Statement

• Processes and methods for designing and executing
  tests of system of systems in the joint mission
  environment are not well defined or understood.
  Nor is there a clear understanding of how to
  assess system performance as it pertains to
  capabilities supporting joint missions.

Overall Goal Recommended Best Practices for a
consistent approach to describing, building, and
using an appropriate representation of a
particular Joint Mission Environment across the
acquisition lifecycle.
Unclassified
6
JTEM Capability Test Methodology (CTM)
2. Plan Test
1. Characterize Test
Statement Of Capabilities (SOC)
Program Introduction Document (PID)
5 Steps 11 JTEM Processes

• Develop Test Concept
• Develop Joint Operational Context for Test
• Develop Evaluation Strategy
• Technical Assessment

• Develop Test Design
• Perform LVC Distributed Environment Analysis
• Develop Test Plan

Integrated Vignettes LVC Distributed Environment
Design
Joint Mission Context Test Concept
3. Implement LVC Distributed Env.

• Validated by MP Working Group Nov 05
• Updated by JTEM Mar 06

Joint Mission Environment
Test Data

• Design LVC Distributed Environment Configuration
• Integrate LVC Distributed Environment

Test Control Monitoring
5. Evaluate Test
4. Execute Test
Joint C2
Client Systems
Threat

• Analyze Data
• Evaluate SoS Performance Joint Mission
  Effectiveness

Environment
Unclassified
LVC Live, Virtual, Constructive
7
JTEM Test Concept
FY09
FY08
FY06
FY05
FY07
Senior Level Review
Senior Level Review
Senior Level Review
Senior Level Review
GOSC
Rehearsals Focus on Process

• MP WG
• Issues
• Top-level MP

Test Gap Analysis Event 1 (NECC)
CTM V1.0
JTEM Baseline CTM
CTM V2.0
CTM V3.0
Test Gap Analysis Event 2 (FCS)
Rock Drills
PARs
PARs
PARs

• JMETC Integration CONOPS
• LVC Event execution MP

Final Products
Interim Products
Interim Products
We are here

• MP Templates
• Handbook
• Recommendations
• Gaps Seams Overlaps

• MP Templates
• Recommendations
• Gaps, Seams Overlaps

• MP Templates
• Recommendations
• Gaps, Seams Overlaps

Test 2 (TBD)
Test 1 AF-ICE
PARs
PARs
JMETC Demos

• MSDE
• Ad hoc Processes
• Test Gap Analysis

PARs
PARs
Actual Tests Focus on Environment
OUTREACH USER DEMOS
POC JTEM_at_jte.osd.mil
FOCUS ON LEGACY PRODUCTS
MP WG - Methods and Processes Working Group
CTTRA - Common Test Training Range
Architecture MSDE - Multi-Service
Distributed Event CTM - Capability Test
Methodology JMETC - Joint Mission Environment
Test Capability FCS - Future Combat System
PAR - Process Anomaly Report JDEP - Joint
Distributed Engineering Plant SDB - Small
Diameter Bomb NECC - Net-Enabled Command
Control MP - Methods and Processes
Unclassified
8
JTEM Products and Transition Strategy
Type 4
Transitions to
Type 1, 2, 3 Products and other Joint
Environment COI Organizations

• GAPS, SEAMS, OVERLAPS
• Input Issues (MP WG, MSDE, CTTRA)
• Rock Drill, Gap Analysis, Test Event Issues
  Watch List Findings
• Process Anomaly Reports (PARs) with associated
  actions

MP WG - Methods and Processes Working Group
CTTRA - Common Test Training Range Architecture
MSDE - Multi-Service Distributed Event PID -
Program Introduction Document JFM - Joint
Mission Environment Foundation Model JME
- Joint Mission EnvironmentSOC - Statement of
Capability SDD - System Design Document
JCER Joint
Capabilities Evaluation Report JMe Joint
Mission Effectiveness CTM Capability
Test Methodology COI Community of
Interest
Unclassified
9
QUESTIONS?

Unclassified