Exercise Evaluation

1
Exercise Evaluation

• Observing and recording exercise activities
• Comparing performance with the objectives
• Identifying strengths and weaknesses

2
Unit Objectives

• Describe the need for a systematic approach to
  exercise evaluation.
• Identify and explain the tasks in the exercise
  evaluation process.

3
Why Evaluate?

• Evaluation can identify
• Whether objectives are achieved.
• Needed improvements in
• Emergency plan, procedures, guidelines.
• Emergency management system.
• Training and staffing deficiencies.
• Equipment deficiencies.
• Need for continued exercising.

4
Evaluation Team
5
Training the Team

• Give an orientation covering
• Scenario.
• Rules of play.
• Objectives.
• Evaluation requirements and procedures.
• Evaluation forms.
• Importance of being unobtrusive.
• Run practice drills if needed.

6
Evaluation Methodology

• Team Structure
• Evaluatorsnumber and background
• Sub-team organization
• Lines of authority
• Communication and coordination

7
Evaluation Methodology

• Evaluation Criteria

8
Evaluation Methodology

• Evaluation Strategy
• Data collection method
• Observation process
• Evaluation forms

9
Post-Exercise Phase

• Postexercise meetings
• Player debriefing
• Evaluation team meetings
• After action report
• Implementing change

10
Player Debriefing

• Occurs immediately after exercise.
• Controller reviews objectives, successes,
  shortfalls.
• Each player comments on performance.
• Comments are recorded for after action report.
• Questionnaire formmay be used.

11
Evaluation Team Meetings

• Compare notes.
• Analyze findings.
• Develop accurate account of what worked and what
  did not.
• Prepare after action report.

12
After Action Report

• Documents effectiveness of the exercise
• Basis for
• Planning future exercises
• Upgrading emergency plan
• Taking corrective action
• Format varies

13
Implementing Change
The goals of an exercise are not achieved until
the recommendations from the evaluation are
implemented.

• Are the procedures sound?
• Are resources sufficient to support procedures?
• Are personnel adequately trained to follow
  procedures and use resources?

14
Unit Summary

• In Unit 8, we
• Discussed the need for a systematic approach to
  exercise evaluation.
• Reviewed aspects of the evaluation process
• Team structure.
• Evaluation methodology.
• Postexercise phase.
• Outlined an evaluation plan for an exercise.

Next Exercise Enhancements