SBFT Tool Competition 2023 - Java Test Case Generation Track
Gunel Jahangirova, Valerio Terragni
Abstract
This paper details the eleventh edition of Java Unit Testing Competition, covering its setup, challenges, and findings. The competition featured five Java test case generation tools: EVOSUITE, KEX-CONCOLIC, KEX-SYMBOLIC, UTBOT-CONCOLIC, and UTBOT-FUZZER, all of which were evaluated on a benchmark of 100 classes taken from 5 open-source Java Projects. We assessed the generated test cases based on code and mutation coverage, as well as human understandability-a metric introduced in this edition of the competition.
Topics & Concepts
JavaComputer scienceConcolic testingBenchmark (surveying)Unit testingCompetition (biology)Metric (unit)Programming languageSymbolic executionSoftwareEngineeringBiologyGeographyGeodesyOperations managementEcologySoftware Testing and Debugging TechniquesSoftware Engineering ResearchSoftware Reliability and Analysis Research