Status Report on Software Testing: Test-Comp 2021
Dirk Beyer
Abstract
Abstract This report describes Test-Comp 2021, the 3rd edition of the Competition on Software Testing. The competition is a series of annual comparative evaluations of fully automatic software test generators for C programs. The competition has a strong focus on reproducibility of its results and its main goal is to provide an overview of the current state of the art in the area of automatic test-generation. The competition was based on 3 173 test-generation tasks for C programs. Each test-generation task consisted of a program and a test specification (error coverage, branch coverage). Test-Comp 2021 had 11 participating test generators from 6 countries.
Topics & Concepts
Computer scienceTest (biology)Competition (biology)SoftwareSoftware engineeringFocus (optics)Test Management ApproachTask (project management)Reliability engineeringProgramming languageSoftware developmentSystems engineeringSoftware constructionEngineeringPaleontologyBiologyOpticsPhysicsEcologySoftware Testing and Debugging TechniquesSoftware Reliability and Analysis ResearchRadiation Effects in Electronics