Phase 2, Documentation: Evaluation Plan
This plan provides exercise evaluators, facilitator, and simulators with guidance concerning procedures and responsibilities for exercise evaluation and support.
Type of Exercise: ________________
Exercise Date: ___________________
Exercise players and organizations participating in exercise
Assumptions, Artificialities, and Simulations
The assumptions, artificialities, and simulations applicable during the exercise are provided in the following paragraphs.
The following assumptions are made in order to ensure that the exercise is as realistic as possible and that exercise objectives be achieved during exercise play.
- Players will respond in accordance with the existing Emergency Plan. In the absence of appropriate written instructions, players will be expected to apply individual initiative.
- Implementation of disaster response plans, policies, and procedures during the exercise will depict actions that would be expected to occur under actual response conditions.
- Real-world response actions will take priority over exercise actions.
While the following artificialities and constraints will detract from realism, exercise planners should accept these artificialities as a way to meet exercise objectives.
- The exercise will be played in near-real time; however, to meet exercise objectives, some events may be played by participants before the exercise, and other events may be accelerated in time.
- Responses obtained by players from simulations may not be of the quality or detail available from the real organization or individual.
- During the exercise, actions may occur to direct unit, personnel, or resource deployments, and subsequent movement of resources may be simulated with no live movement occurring in the exercise.
Exercise Evaluation Team Staffing, Rules, and Procedures
The personnel selected as exercise evaluation team members will need to understand ongoing exercise activities and to be able to track them with events in the MSEL.
Evaluators should be familiar with the following:
- Purpose and objectives of the exercise
- MSEL and scenario timeline
- Content of exercise messages
- Procedures for monitoring and tracking player actions
- Procedures for recording observation of player actions
- Procedures for notifying facilitator of problems and exercise deviations
In this section identify the exercise objectives and evaluator checklists. Points of review should be based on the emergency operations plans, policies, procedures, guidelines, and checklists.
Prior to the exercise, all exercise evaluation documents should be appended to the plan. They may be organized by site location, by function, or any other method as determined by the evaluation team.
Exercise Evaluation Team Responsibilities
- Observe the exercise
- Report what went well and what went poorly
- Monitor decisions made in the exercise and then report on them
Evaluators may record their observations on paper, or through the use of an Evaluator Reporting Checklist.
Attach a copy of:
- Expected actions
- Major and detailed events
- Key messages