Supporting Information may be found in the online version of this article.
Extended comprehensive study of association measures for fault localization†
Article first published online: 29 AUG 2013
Copyright © 2013 John Wiley & Sons, Ltd.
Journal of Software: Evolution and Process
Volume 26, Issue 2, pages 172–219, February 2014
How to Cite
Lucia, L., Lo, D., Jiang, L., Thung, F. and Budi, A. (2014), Extended comprehensive study of association measures for fault localization. J. Softw. Evol. and Proc., 26: 172–219. doi: 10.1002/smr.1616
- Issue published online: 24 JAN 2014
- Article first published online: 29 AUG 2013
- Manuscript Accepted: 19 JUL 2013
- Manuscript Revised: 4 JUL 2013
- Manuscript Received: 8 APR 2012
- Association Measures;
- Fault Localization;
- Program Spectra
Spectrum-based fault localization is a promising approach to automatically locate root causes of failures quickly. Two well-known spectrum-based fault localization techniques, Tarantula and Ochiai, measure how likely a program element is a root cause of failures based on profiles of correct and failed program executions. These techniques are conceptually similar to association measures that have been proposed in statistics, data mining, and have been utilized to quantify the relationship strength between two variables of interest (e.g., the use of a medicine and the cure rate of a disease). In this paper, we view fault localization as a measurement of the relationship strength between the execution of program elements and program failures. We investigate the effectiveness of 40 association measures from the literature on locating bugs. Our empirical evaluations involve single-bug and multiple-bug programs. We find there is no best single measure for all cases. Klosgen and Ochiai outperform other measures for localizing single-bug programs. Although localizing multiple-bug programs, Added Value could localize the bugs with on average smallest percentage of inspected code, whereas a number of other measures have similar performance. The accuracies of the measures in localizing multi-bug programs are lower than single-bug programs, which provokes future research. Copyright © 2013 John Wiley & Sons, Ltd.