VECMAtk: A Scalable Verification, Validation and Uncertainty Quantification toolkit for Scientific Simulations
Derek Groen, Hamid Arabnejad, Vytautas Jancauskas, Wouter Edeling, Fredrik Jansson, Robin A. Richardson, Jalal Lakhlili, Lourens Veen, Bartosz Bosak, Piotr Kopta, David W. Wright, Nilah Monnier, Paul Karlshoefer, Diana Suleimenova, R. Sinclair, Maxime Vassaux, Anna Nikishova, M. Bieniek, O. O. Luk, Michał Kulczewski, Erwan Raffin, Daan Crommelin, O. Hoenen, D. Coster, Tomasz Piontek, Peter V. Coveney
Abstract
We present the VECMA toolkit (VECMAtk), a flexible software environment for single and multiscale simulations that introduces directly applicable and reusable procedures for verification, validation (V&V), sensitivity analysis (SA) and uncertainty quantification (UQ). It enables users to verify key aspects of their applications, systematically compare and validate the simulation outputs against observational or benchmark data, and run simulations conveniently on any platform from the desktop to current multi-petascale computers. In this sequel to our paper on VECMAtk which we presented last year, we focus on a range of functional and performance improvements that we have introduced, cover newly introduced components, and applications examples from seven different domains such as conflict modelling and environmental sciences. We also present several implemented patterns for UQ/SA and V&V, and guide the reader through one example concerning COVID-19 modelling in detail.