Mitigating Noise in Quantum Software Testing Using Machine Learning

Abstract

Quantum Computing (QC) promises computational speedup over classic computing. However, noise exists in near-term quantum computers. Quantum software testing (for gaining confidence in quantum software's correctness) is inevitably impacted by noise, i.e., it is impossible to know if a test case failed due to noise or real faults. Existing testing techniques test quantum programs without considering noise, i.e., by executing tests on ideal quantum computer simulators. Consequently, they are not directly applicable to test quantum software on real quantum computers or noisy simulators. Thus, we propose a noise-aware approach (named <inline-formula><tex-math notation="LaTeX">$\mathit{QOIN}$</tex-math></inline-formula>) to alleviate the noise effect on test results of quantum programs. <inline-formula><tex-math notation="LaTeX">$\mathit{QOIN}$</tex-math></inline-formula> employs machine learning techniques (e.g., transfer learning) to learn the noise effect of a quantum computer and filter it from a program's outputs. Such filtered outputs are then used as the input to perform test case assessments (determining the passing or failing of a test case execution against a test oracle). We evaluated <inline-formula><tex-math notation="LaTeX">$\mathit{QOIN}$</tex-math></inline-formula> on IBM's 23 noise models, Google's two available noise models, and Rigetti's Quantum Virtual Machine, with six real-world and 800 artificial programs. We also generated faulty versions of these programs to check if a failing test case execution can be determined under noise. Results show that <inline-formula><tex-math notation="LaTeX">$\mathit{QOIN}$</tex-math></inline-formula> can reduce the noise effect by more than <inline-formula><tex-math notation="LaTeX">$80\%$</tex-math></inline-formula> on most noise models. We used an existing test oracle to evaluate <inline-formula><tex-math notation="LaTeX">$\mathit{QOIN}$</tex-math></inline-formula>'s effectiveness in quantum software testing. The results showed that <inline-formula><tex-math notation="LaTeX">$\mathit{QOIN}$</tex-math></inline-formula> attained scores of <inline-formula><tex-math notation="LaTeX">$99\%$</tex-math></inline-formula>, <inline-formula><tex-math notation="LaTeX">$75\%$</tex-math></inline-formula>, and <inline-formula><tex-math notation="LaTeX">$86\%$</tex-math></inline-formula> for precision, recall, and F1-score, respectively, for the test oracle across six real-world programs. For artificial programs, <inline-formula><tex-math notation="LaTeX">$\mathit{QOIN}$</tex-math></inline-formula> achieved scores of <inline-formula><tex-math notation="LaTeX">$93\%$</tex-math></inline-formula>, <inline-formula><tex-math notation="LaTeX">$79\%$</tex-math></inline-formula>, and <inline-formula><tex-math notation="LaTeX">$86\%$</tex-math></inline-formula> for precision, recall, and F1-score respectively. This highlights <inline-formula><tex-math notation="LaTeX">$\mathit{QOIN}$</tex-math></inline-formula>'s effectiveness in learning noise patterns for noise-aware quantum software testing.

Topics & Concepts