SBFT Tool Competition 2023 - Cyber-Physical Systems Track
Matteo Biagiola, Stefan Klikovits, Jarkko Peltomäki, Vincenzo Riccio
Abstract
We report on the organization and results of the third edition of the Cyber-Physical Systems tool competition, held as part of the SBFT workshop. Six tools (i.e., CRAG, EvoMBT, RIGAA, RoadSign, Spirale, and WOGAN) competed with the aim of triggering failures of two autonomous driving agents.We evaluated the effectiveness of the tools in exposing failures as well as the diversity of the generated failures. This report describes our methodology, the competitors, the results, and the challenges we faced while running the competition experiments.
Topics & Concepts
Competition (biology)Competitor analysisTrack (disk drive)Cyber-physical systemComputer scienceDiversity (politics)BusinessOperating systemMarketingBiologyAnthropologySociologyEcologySoftware Testing and Debugging TechniquesAutonomous Vehicle Technology and SafetySafety Systems Engineering in Autonomy