Technical and Usability Evaluation of TNO's LOCI Software


  1. Filardo, E-A.
  2. Morton, A.
  3. Thomson, M.H.
Corporate Authors
Defence Research and Development Canada, Toronto Research Centre , Toronto ON (CAN);Humansystems Inc, Guelph ONT (CAN)
This study was conducted in support of the Defence Research and Development Canada – Toronto Research Centre’s “Training Toolkit for the Comprehensive Approach” project. The aim of this project is to provide tools to the Canadian Armed Forces (CAF) that will allow them to better train for Comprehensive Approach (CA) operations. This current study was undertaken to evaluate the usefulness and usability of the beta version of TNO’s Levels of Chosen Interdependence (LOCI) software for the CAF. This software was identified as a potential tool to meet the priorities outlined by Subject-Matter Experts (SMEs) in prior studies conducted for the “Training Toolkit” project. To evaluate the software, both a technical and a usability evaluation were conducted. In the technical evaluation, 16 novice participants were trained in the LOCI method for evaluating cooperation partners. They took part in two sessions and answered decision-making questions about the potential cooperation partners. To determine the answers participants used a paper-and-pencil methodology in one session and used the provided LOCI computer software in another session. The accuracy of their responses did not differ across the two methodologies, though there was an interaction effect indicating that when participants used the LOCI software first, they answered more questions correctly than when they used the paper-and-pencil methodology first. In the usability evaluation, the 16 novice participants as we
comprehensive approach;planning;whole of government;JIMP
Report Number
DRDC-RDDC-2015-C197 — Contract Report
Date of publication
01 Mar 2015
Number of Pages
Electronic Document(PDF)

Permanent link

Document 1 of 1

Date modified: