A Decision Support System Evaluation Methodology to Demonstrate the Net Decision Making Effectiveness: The Decision Centered Evaluation Capability (DCEC) TIF Project

Authors
  1. Paradis, S.
  2. Elm, W.C.
  3. Potter, S.S.
Corporate Authors
Defence R&D Canada - Valcartier, Valcartier QUE (CAN)
Abstract
Decision Support Systems (DSS) development is challenging, as it requires the elicitation of critical cognitive demands/decision requirements and information/transformation requirements inherent to the decision making domain. This is an essential condition, as one needs to know and understand the critical decisions that a decision maker has to take before envisaging the design of a computer-based decision supportive aid. While work continues on designing DSSs, an even greater challenge is the evaluation of the dynamic human decision making performance when using a newly designed computer-based decision support capability. Such an assessment must be focused on the net (human-system combination) decision making effectiveness. Current evaluation methods focus on system technical attributes or crude memory tests. What is needed is a revolutionary advance in 'in situ' validation of improved C2 decisions when a C4I system is given to a user. This Technology Investment Fund project proposes to develop an innovative Decision Centered Evaluation Capability (DCEC) for the evaluation and operational Impact Assessment of C4I decision support systems for military command and control applications.

Il y a un résumé en français ici.

Keywords
Cognitive Work Analysis;Decision Making Effectiveness;Cognitive systems engineering;Decision support system;Decision aids;Cognitive task analysis;Technology Investment Fund
Report Number
DRDC-VALCARTIER-TN-2003-279 — Technical Note
Date of publication
01 Jul 2004
Number of Pages
28
DSTKIM No
CA024346
CANDIS No
521909
Format(s):
Electronic Document(PDF)

Permanent link

Document 1 of 1

Date modified: