Automated metamorphic testing of variability analysis tools (pages 138–163)
Sergio Segura, Amador Durán, Ana B. Sánchez, Daniel Le Berre, Emmanuel Lonca and Antonio Ruiz-Cortés
Article first published online: 13 JAN 2015 | DOI: 10.1002/stvr.1566
We present an approach for the automated detection of faults in variability analysis tools overcoming the oracle problem. Our work enables the generation of random variability models together with their exact set of valid configurations. Test data are generated from scratch using stepwise transformations and assuring that certain metamorphic relations hold at each step. For the evaluation, we automatically tested several tools in three domains: feature models, common upgradeability description format documents, and Boolean formulas. We detected 19 real bugs in 7 tools.