Selecting Methods for the Analysis of Reliance on Automation

Choisir des méthodes pour l’analyse de la dépendance à l’égard de l’automatisation


  1. Wang, L.
  2. Jamieson, G.A.
  3. Hollands, J.G.
Corporate Authors
Defence R&D Canada - Toronto, Toronto ONT (CAN);Virginia Univ, Charlottesville VA (US);Toronto Univ, Toronto ONT (CAN)
Human reliance on imperfect automation has been the subject of many laboratory experiments. Across these studies, a diverse set of indices of reliance have been used, even in studies with similar experiment settings. This inconsistency of reliance measures makes the meta-analysis of experimental findings difficult. Moreover, few researchers have rigorously defined the optimal level of automation reliance in their settings, making it difficult to judge the appropriateness of that reliance. This paper attempts to guide researchers in selecting and interpreting measures of automation reliance behavior. We review the reliance analysis methods in existing research and propose four criteria for selecting among them. It is recommended that, where possible, future studies define optimal reliance to make unequivocal judgment about the appropriateness of reliance. In addition, more reliable and insightful conclusions can be obtained through the use of multiple measures.

Il y a un résumé en français ici.

automated systems, combat identification, reliance, reliability
Report Number
DRDC-TORONTO-SL-2008-193 — Scientific Literature
Date of publication
22 Sep 2008
Number of Pages
Reprinted from
Proceedings of the Human Factors and Ergonomics Society, 2008, p 287-291
Electronic Document(PDF)

Permanent link

Document 1 of 1

Date modified: