Initial validation of the decision centered testing methodology

PDF

Authors
  1. Jobidon, M-E.
  2. Breton, R.
Corporate Authors
Defence R&D Canada - Valcartier, Valcartier QUE (CAN)
Abstract
In the context of military operations, human operators have access to decision support systems (DSS) to help them carry out the decision-making process efficiently and successfully. To ensure that humans and systems work in a coordinated manner, there is a need for a testing approach that will focus on the human-DSS team and assess their combined efficiency. The Decision Centered Testing (DCT) methodology constitutes an innovative approach to evaluation that aims to test the decision-making effectiveness of the human-DSS team, called the Joint Cognitive System (JCS; Hollnagel & Woods, 2005). This report presents the results of two tests that constitute the initial effort in validating the DCT methodology. The two tests conducted addressed different stages of the research methods continuum; that is, a relatively complex and dynamic task environment and a more controlled and static task. This first validation of DCT shows promises, and highlights some potential pitfalls that one should be mindful of in conducting further validation studies. DCT could eventually contribute significantly to the DSS evaluation process, especially in light of its focus on the JCS.

Il y a un résumé en français ici.

Keywords
Testing & Evaluation;Decision Making;Cognitive System Engineering;Design Requirements;Human Computer Interaction;Usability Testing;Software Testing;Joint Cognitive System;Decision Support Systems (DSS);MOE (Measures of Effectiveness);MOP (Measures of Performance);Software usability
Report Number
DRDC-VALCARTIER-TR-2008-302 — Technical Report
Date of publication
01 Feb 2009
Number of Pages
68
DSTKIM No
CA031821
CANDIS No
530793
Format(s):
Electronic Document(PDF)

Permanent link

Document 1 of 1

Date modified: