A Streamlined Scenario-Based Methodology for Evaluating Distributed Team Performance

Period of Performance: 05/16/2000 - 10/16/2003


Phase 2 SBIR

Recipient Firm

Aptima, Inc.
12 Gill Street Array
Woburn, MA 01801
Principal Investigator


Distributed Mission Training (DMT) has enormous potential to improve skills and increase readiness in the Air Force. To fully realize this potential, however, better methods are needed to assess the performance of distributed teams in simulation environments. In Phase II, we will apply streamlined theory-based methods to develop event-based individual and team performance measures for a variety of DMT scenarios; apply and validate these measures at DMT exercises; and create a database of scenario-based performance measures and performance data, linked to competencies an learning objectives. To access this database, we will develop and demonstrate a scenario engineering tool that will allow designers to create scenarios by retrieving events, with associated measures, to satisfy learning objectives. No such tool currently exists for Air Force DMT. The scenario-based performance measurement database and associated scenario engineering tool represent an unique capability to make Air Force DMT more effective. The initial application of the approach, demonstrated in Phase I, will be to F-16 and F-15 pilots in simulation-based training environments, linked to AWACS Weapons Directors, also in simulation environments. Successful development and demonstration in Phase II holds the potential to improve training effectiveness in multiple military and commerical DMT environments.