Statistical Evaluation of Information Source Performance

PDF

Authors
  1. Schaub, D.E.
Corporate Authors
Defence Research and Development Canada, Atlantic Research Centre, Halifax NS (CAN)
Abstract
The present work examines the problem of evaluating the performance of statistically-characterized information sources when ground truth is unavailable. Although exact verification may be infeasible, inter-source statistical dependencies may be used to test for information consistency. Through application of a Rosenblatt transformation on an input sample and subsequent Kolmogorov–Smirnov test against the uniform distribution, a given information source can be statistically evaluated for goodness of fit. An algorithm is derived for detecting the presence of suspect information and identifying the associated aberrant source(s). The paper concludes with an example that considers the detection of a malfunctioning radar system in the absence of ground truth.
Keywords
information validation;sensor performance;fusion;Kolmogorov–Smirnov test;Rosenblatt transformation
Report Number
DRDC-RDDC-2015-P149 — External Literature
Date of publication
13 Jan 2016
Number of Pages
8
DSTKIM No
CA041897
CANDIS No
803033
Format(s):
Electronic Document(PDF)

Permanent link

Document 1 of 1

Date modified: