Software Testing, Verification and Reliability

Cover image for Vol. 24 Issue 3

Early View (Online Version of Record published before inclusion in an issue)

Edited By: Jeff Offutt and Robert M. Hierons

Impact Factor: 1.043

ISI Journal Citation Reports © Ranking: 2012: 46/105 (Computer Science Software Engineering)

Online ISSN: 1099-1689

Associated Title(s): Journal of Software: Evolution and Process, Software Process: Improvement and Practice, Software: Practice and Experience


  1. 1 - 12
  1. Special Issue Papers

    1. Test generation from recursive tile systems

      Sébastien Chédor, Thierry Jéron and Christophe Morvan

      Article first published online: 2 APR 2014 | DOI: 10.1002/stvr.1525

      Thumbnail image of graphical abstract

      This paper presents a formal conformance test cases generation technique for recursive systems. These systems are modelled by recursive tile systems, which are defined by a finite collection of finite graphs (tiles), each of these equipped with a frontier that expresses how tiles are connected. Both on-line and off-line techniques are presented. Copyright © 2014 John Wiley & Sons, Ltd.

    2. UNICORN: a unified approach for localizing non-deadlock concurrency bugs

      Sangmin Park, Richard Vuduc and Mary Jean Harrold

      Article first published online: 9 MAR 2014 | DOI: 10.1002/stvr.1523

      Thumbnail image of graphical abstract

      UNICORN is an automated dynamic pattern-detection-based technique that finds problematic memory access patterns for non-deadlock concurrency bugs. It detects significant classes of bug types, including order violations and both single-variable and multi-variable atomicity violations. This paper describes the UNICORN approach and its implementations in Java and C++, and evaluates these implementations empirically. Copyright © 2014 John Wiley & Sons, Ltd.

    3. Killing strategies for model-based mutation testing

      Bernhard K. Aichernig, Harald Brandl, Elisabeth Jöbstl, Willibald Krenn, Rupert Schlick and Stefan Tiran

      Article first published online: 3 FEB 2014 | DOI: 10.1002/stvr.1522

      Thumbnail image of graphical abstract

      This paper presents a model-based test case generation approach that automatically derives test cases from UML state machines. The technique is based on the mutation analysis of test models. In the two case studies, different fault-based test case generation strategies are compared. Copyright © 2014 John Wiley & Sons, Ltd.

  2. Research Articles

    1. A model-free and state-cover testing scheme for semaphore-based and shared-memory concurrent programs

      Gwan-Hwan Hwang, Che-Sheng Lin, Teng-Shuo Lee and Chi Wu-Lee

      Article first published online: 13 JAN 2014 | DOI: 10.1002/stvr.1520

      Thumbnail image of graphical abstract

      We present a new framework for performing dynamic testing of semaphore-based and shared-memory concurrent programs. The proposed scheme only has to analyze the synchronization sequences (SYN-sequences) that are collected during the dynamic testing of the concurrent program - static analysis of the syntax and semantics of the program is unnecessary. If the tested concurrent program has an infinite number of SYN-sequences, state-cover testing of the target program can be performed (if the execution states of the target concurrent program are finite). Copyright © 2014 John Wiley & Sons, Ltd.

    2. Exploring the missing link: an empirical study of software fixes

      Maggie Hamill and Katerina Goseva-Popstojanova

      Article first published online: 7 OCT 2013 | DOI: 10.1002/stvr.1518

      Thumbnail image of graphical abstract

      The paper is focused on empirical characterization of software fixes. The results show that significant number of software failures require fixes in multiple software components and/or multiple software artifacts (i.e. 15% and 26%, respectively). The patterns of software components that are often fixed together are significantly affected by the software architecture. Furthermore, the types of fixed software artifacts are highly correlated with fault type, and they have different distributions for prerelease and post-release failures.

  3. Special Issue Papers

    1. Metallaxis-FL: mutation-based fault localization

      Mike Papadakis and Yves Le Traon

      Article first published online: 9 SEP 2013 | DOI: 10.1002/stvr.1509

      Thumbnail image of graphical abstract

      This paper proposes Metallaxis, a fault localization approach based on mutation analysis. The innovative part of Metallaxis is that is it uses mutants and links them with the faulty program places. Thus, mutants that are killed mostly by failing tests provide a good indication about the location of a fault. Experimentation using Metallaxis suggests that it is significantly more effective than statement-based approaches. This is true even in the case that mutation cost-reduction techniques, such as mutant sampling, are facilitated.

  4. Research Articles

    1. Search-based testing using constraint-based mutation

      Jan Malburg and Gordon Fraser

      Article first published online: 30 AUG 2013 | DOI: 10.1002/stvr.1508

      Thumbnail image of graphical abstract

      Many modern automated test generators are based on either metaheuristic search techniques or use constraint solvers. Both approaches have their advantages, but they also have specific drawbacks. This paper describes a method that integrates both techniques and delivers the best of both worlds. Experiments on 20 case study programs show an increase in coverage and a reduction in test set size over traditional techniques.

    2. Extending model checkers for hybrid system verification: the case study of SPIN

      María-del-Mar Gallardo and Laura Panizo

      Article first published online: 26 JUL 2013 | DOI: 10.1002/stvr.1505

      Thumbnail image of graphical abstract

      This paper presents a new methodology to extend explicit model checkers for hybrid systems analysis. The explicit model checker is integrated, in a non-intrusive way, with some external structures and existing abstraction libraries, which store and manipulate the abstraction of the continuous behaviour irrespective of the underlying model checker. The methodology is applied to SPIN using Parma Polyhedra Library.

    3. An improved Pareto distribution for modelling the fault data of open source software

      Shao-Pu Luan and Chin-Yu Huang

      Article first published online: 23 JUL 2013 | DOI: 10.1002/stvr.1504

      Thumbnail image of graphical abstract

      In this paper, a Single-Change-Point 2-Parameter Generalized Pareto Distribution (SCP-2GPD) model is proposed to model and analyze the fault distribution of Open Source Software. Experimental results show that proposed SCP-2GPD model has a flexible structure and can be used to model a wide spectrum of software development environments.

    4. Towards the prioritization of system test cases

      Hema Srikanth, Sean Banerjee, Laurie Williams and Jason Osborne

      Article first published online: 5 JUN 2013 | DOI: 10.1002/stvr.1500

      Thumbnail image of graphical abstract

      The prioritization of requirements for test (PORT) scheme allows development teams to effectively prioritize test cases by using four factors: customer priority, requirements volatility, implementation complexity, and fault proneness. When compared with a random prioritization approach, PORT shows better results, which were also statistically significant. PORT has been validated using four student projects and one industry project. Of the four port factors, customer priority, was the most important contributor towards improved failure detection.

    5. Sound and mechanised compositional verification of input-output conformance

      Augusto Sampaio, Sidney Nogueira, Alexandre Mota and Yoshinao Isobe

      Article first published online: 14 MAY 2013 | DOI: 10.1002/stvr.1498

      Thumbnail image of graphical abstract

      This paper mechanises conformance verification in the setting of the CSP process algebra, using the FDR model checker, by establishing compositionality properties for the conformance relation (cspio) with respect to the CSP operators. We explore under which conditions cspio is equivalent to Tretmans ioco. All the results have been mechanically proved using the CSP-Prover. The proposed testing theory has been adopted in an industrial context involving collaboration with Motorola, on testing mobile applications.

    6. Analysis and testing of black-box component-based systems by inferring partial models

      Muzammil Shahbaz and Roland Groz

      Article first published online: 17 FEB 2013 | DOI: 10.1002/stvr.1491

      Thumbnail image of graphical abstract

      An iterative approach is presented that combines techniques from grammatical inference and model-based testing domains to fulfil two main purposes: (i) reverse engineering of black-box components by inferring (partial) models and (ii) validating integrated systems of such components for compositional problems and generic errors by using their inferred models. The paper investigates how the ‘oracle’ assumption in the classic learning theory can be avoided practically and furthermore how existing model-based approaches can be exploited for testing components whose models are unavailable.


  1. 1 - 12