Measurement of Individual and Team Situation Awareness: A Critical Evaluation of the Available Metrics and Tools and their Applicability to Command and Control Environments

PDF

Authors
  1. Breton, R.
  2. Tremblay, S.
  3. Banbury, S.
Corporate Authors
Defence R&D Canada - Valcartier, Valcartier QUE (CAN);Laval Univ, Quebec (Que) Computer Vision and Systems Lab
Abstract
The objectives with this document are to provide a critical evaluation of the psychometric properties of the available individual and team situation awareness (SA) measurement tools and techniques and to evaluate the applicability of the SA measurement tools found in the literature to C2 environments. This report is based on an exhaustive literature survey of SA measurement and a search for tools and techniques that have been used to measure individual and team SA. The emphasis is on the psychometric properties of the tools, such as reliability, validity and sensitivity. The survey reveals a wide variety of tools, techniques and metrics but very little information about their psychometric properties. In many cases validity and reliability data are rather inconclusive and incomplete with rather small samples. Nevertheless some well-established measures of SA such as SAGAT and SART have proved to be useful in evaluating new interfaces or system designs and training programs. One key problem with SA measurement is the wide variety of measures for a large number of situations. There are nearly as many different measurement techniques as there are different situations in which an operator is at work and each situation has its own sets of procedures, task requirements and demands. According to the distribution of the SA measurement tools among the C2 environments, the SA concept can be measured in every situation. In some occasions, a slight modification of an existing measure can

Il y a un résumé en français ici.

Keywords
Situation Awareness;Situation Assessment;Measurement;Measurement tool;Assessment Method;Human Performance,;Teamwork;Team Performance;Team Shared Awareness;Team Shared Assessment
Report Number
DRDC-VALCARTIER-TR-2003-283 — Technical Report
Date of publication
01 May 2007
Number of Pages
114
DSTKIM No
CA029348
CANDIS No
527639
Format(s):
CD ROM

Permanent link

Document 1 of 1

Date modified: