AGGREGATE CERTAINTY ESTIMATORS
Article first published online: 26 JUN 2012
© 2012 Wiley Periodicals, Inc.
Volume 29, Issue 2, pages 207–232, May 2013
How to Cite
Monteith, K. and Martinez, T. (2013), AGGREGATE CERTAINTY ESTIMATORS. Computational Intelligence, 29: 207–232. doi: 10.1111/j.1467-8640.2012.00433.x
- Issue published online: 7 MAY 2013
- Article first published online: 26 JUN 2012
- Received 16 March 2011; Revised 20 August 2011; Accepted 22 January 2010
- combining classifiers;
- certainty estimators;
- multiclassifier systems;
- supervised learning
Selecting an effective method for combining the votes of base inducers in a multiclassifier system can have a significant impact on the system’s overall classification accuracy. Some methods cannot even achieve as high a classification accuracy as the most accurate base classifier. To address this issue, we present the strategy of aggregate certainty estimators, which uses multiple measures to estimate a classifier’s certainty in its predictions on an instance-by-instance basis. Use of these certainty estimators for vote-weighting allows the system to achieve a higher overall average in classification accuracy than the most accurate base classifier. Weighting with these aggregate measures also results in higher average classification accuracy than weighting with single certainty estimates. Aggregate certainty estimators outperform three baseline strategies, as well as the methods of modified stacking and arbitration, in terms of average accuracy over 36 data sets.