A FRAMEWORK FOR EVALUATION OF MILITARY COMMAND AND CONTROL SYSTEMS

PDF

Authors
  1. Matthews, M.L.
  2. Webb, R.D.G.
  3. McCann, C.
Corporate Authors
Defence and Civil Inst of Environmental Medicine, Downsview ONT (CAN);Humansystems Inc, Guelph ONT (CAN)
Abstract
The report proposes a framework for the evaluation of information systems intended to support generic military Command and Control (C2) functions. The recommendations are based on analysis of relevant evaluation literature on military C2 systems and other complex dynamic environments such as nuclear power generation and air traffic control. The framework comprises three major human-systems areas as the focus of evaluation: Function Usability, User Fit, and Operational Impact. Each of these areas would be assessed using three evaluation configurations: Story Board, Test Bed and Full Scale Simulation or Field Trial. Within each configuration, representative users assess the system in question through the use of standardized scenarios. The specific evaluation approach to be adopted in any given context will depend on both the degree of development of the system under question and evaluation opportunities available. For User Fit, priority should be given to evaluating the ability of the system to maintain situation awareness, communication effectiveness (within and between teams), decision support and management of mental workload. The keys to the evaluation framework outlined in this report are: - Application from the start of development including concept acceptance. Independence of the development group. Scientific reliability and rigor in the measurement process. TRUNCATED
Keywords
Function Usability;User Fit;Operational Impact
Report Number
DCIEM-97-CR-24 — Contract Report
Date of publication
13 Jun 1997
Number of Pages
98
DSTKIM No
98-00738
CANDIS No
506674
Format(s):
Hardcopy;Document Image stored on Optical Disk

Permanent link

Document 1 of 1

Date modified: