Working Group:

1
Working Group
RESEARCH TOPICS IN PROGRAM AND PROJECT MANAGEMENT
Sponsored by The Universities Space Research
Association and NASA/Academy of Program and
Project Leadership
Decision Making Tools Methods and Metrics

• 9-10 December 2003

Final Report
Session Chair Mark George Rapporteur Jeff
Cardenas
2
Session Members
Session I
Session II

• Jeff Cardenas
• Steven Collicott
• Mark George
• Peter Madsen
• Melissa Sampson
• Winston Sieck
• Willie Thompson

• Jeff Cardenas
• Steven Collicott
• Mark George
• Peter Madsen
• Winston Sieck
• Willie Thompson

3
Research Topics
Highest to Lowest Priority

• How does the expert PPM manage the
  decision-making processes?
• Define team interaction methodology in the
  decision-making process.
• Define the criteria for program metrics, with
  traceable results addressing stakeholder and
  customer interests.
• Definition and validation of tools and
  methodologies, and their Utilization.
• Education vehicle for PPM training at the
  University level (undergraduate/graduate)

Cross Cutting Theme
All research projects need take into account the
implementation of Metrics, Traceability, Data
Capture and Knowledge Management
4
Research Project 1
Challenges How does the expert PPM manage the
decision-making processes?

• How does one identify the elements, processes,
  and methodologies in decision making?
• Human, Automated and their Relationships
• What are the Diversities of experiences, skills,
  and talent required?
• How to overcome the lack of Integrated Management
  across program elements?
• Need for Identification and understanding of
  customer and stakeholder needs, how does it
  relate to decision-making?
• Is current acquisition process and contracting
  structure correct or suited for the future of
  complex and high risk projects?

Objective

• To identify and define the following
• Cognitive skills and methodologies required to
  execute decision-making ?
• How do tools and analyses supplement the
  decision-making process ?
• Through analysis of the human and automated
  aspects of decision-making processes, critical
  skills, tools, and methods can be identified for
  potential education and application

Rationale
5
Research Project 2
Challenges Define team interaction methodology
in the decision-making process.

• Capture Past, Current performance, issues, and
  concerns
• Application of experience and lesson learned
• Understanding and bridging communications between
  Systems Engineering and Systems Management
• The interaction and Communication between
  Systems, Sub-systems, Components, and People.

Objective

• Analysis of program/project dynamics and
  interactions in order to establish criteria for
  metrics, with traceable results addressing
  stakeholder and customer interests
• Identify interoperability/interdependency of
  metrics
• Determine applicability of metrics to
  program/project type
• Characteristics of the decision-making processes
  and metrics

Rationale

• Through the identification and definition of the
  program/project dynamics and team interactions,
  an integrated approach and methodology can
  potentially be developed for evaluation,
  implementation , and education purposes.

6
Research Project 3
Challenges Define the criteria for program
metrics, with traceable results addressing
stakeholder and customer interests.

• How will early identification of Critical Values,
  Events, Paths, Team Attributes, and other issues
  in judgment-making assist in the team methodology
  ?
• How to recognize, judge, and resolve Dissent or
  Question Management ?
• What are the meaningful Metrics to judge
  performance ?

Objective

• Define team interaction methodology in the
  decision-making process
• Human attributes and judgment skills involved
• Management and control with respect to
  decision-making methodology
• Management of debate and dissent,leading to
  validation and closure
• Balance between divergent and convergent team
  interaction

Rationale

• Continuous (spiral) best practices and
  performance metrics for traceability back into
  customer, stakeholder and Project
• Total team buy-in at all levels and phases

7
Research Project 4
Challenges Definition and validation of tools
and methodologies, and their Utilization.

• Will Situation Assessment/Awareness expertise and
  risk mitigation management and appropriate tools
  and methods to capture metrics be effective for
  PPM ?
• Application tools and theories (Generic and
  custom approaches), how do they influence
  decision-making ?
• What are the meaningful Metrics to judge
  performance ?
• Standard Definition/Vocabulary
• Hasty Technical decision W/O due diligence for
  through Engineering Analysis

Objective

• Foster the definition and development of the
  following
• Creation and validation of existing, new (COTS),
  or new innovative approaches
• Understand the environment and level at which the
  decision is made
• Determine the fidelity required at each level
• Interdependence and integration of tools and
  methodologies
• Determine the usability and efficiency of tools.

Rationale

• Continuous (spiral) best practices and
  performance metrics with established criteria for
  traceability back into customer, stakeholder, and
  Project

8
Research Project 5Cross Cutting Theme
Challenges Education vehicle for PPM training at
the University level (undergraduate/graduate)

• How does education and value-added of existing,
  new, tool sets and methodology create better PPM
  ?
• Research, tool validation
• Education and training
• Develop Standardized Systems Management

Objective

• Education vehicle for PPM training at the
  University level (undergraduate/graduate)
• Curriculum development to address
• Impact of Government/industry sponsorship of
  University projects
• Appropriate interaction between experiential
  education versus formal education
• What are the best ways to integrate PPM lessons
  into hands-on projects
• Metrics involved in tracking/measuring
  effectiveness of PPM training

Rationale

• To impact and affect continued education,
  including individual growth via education and
  training with insight and viability into the
  decision-making process