A HUMAN FACTORS FRAMEWORK FOR USER EVALUATION IN THE NORAD R/SAOC MODERNIZATION PROJECT. PART I: RECOMMENDED METHODS AND MEASURES

PDF

Authors
  1. Matthews, M.L.
  2. Webb, R.D.G.
  3. MacLean, C.E.
  4. McCann, C.A.
Corporate Authors
Defence and Civil Inst of Environmental Medicine, Downsview ONT (CAN);Humansystems Inc, Guelph ONT (CAN)
Abstract
The document is the first of a two part report on Human Factors methods of evaluation carried out under contract to the Defence and Civil Institute of Environmental Medicine (DCIEM). This contract is part of the North American Air Defense (NORAD) modernization of the Regional and Sector Air Operations Centres (R/SAOCs) Hughes AN/FYQ-93 computer system. This part of the report recommends an evaluation model based on the literature review and familiarization work reported in Part II. The recommended evaluation model is a scenario-based approach. It involves representative users assessing three human-system domain areas (Feature Usability, User Fit, and Operational Impact) at three levels of simulation fidelity (Story Board, Test Bed and Field Trial). Final evaluation approach will depend on the degree of development and integration of the various system components. Within the domain of User Fit, priority should be given to evaluating the ability of the system to support situation awareness, communication effectiveness (within and between teams), and management of mental workload. This part of the report includes the following sections: - An outline of the elements included in the recommended evaluation framework. - An outline of requirements for baseline evaluation. - Example evaluation measures. Preparatory steps for implementation of the evaluation model. Annex A: Measures of Performance; Annex B: Options for Baseline Testing.
Keywords
Mental workloads
Report Number
DCIEM-97-CR-03-PT-1 — Contractor Report
Date of publication
17 Feb 1997
Number of Pages
62
DSTKIM No
97-02713
CANDIS No
502977
Format(s):
Hardcopy;Document Image stored on Optical Disk

Permanent link

Document 1 of 1

Date modified: