Evaluating the Performance of NVIDIA’s A100 Ampere GPU for Sparse and Batched Computations
Hartwig Anzt, Yu‐Hsiang Tsai, Ahmad Abdelfattah, Terry Cojean, Jack Dongarra
Abstract
GPU accelerators have become an Important backbone for scientific high performance-computing, and the performance advances obtained from adopting new GPU hardware are significant. In this paper we take a first look at NVIDIA's newest server-line GPU, the A100 architecture, part of the Ampere generation. Specifically, we assess its performance for sparse and batch computations, as these routines are relied upon in many scientific applications, and compare to the performance achieved on NVIDIA's previous server-line GPU.
Topics & Concepts
Computer scienceParallel computingComputationSupercomputerCUDAGeneral-purpose computing on graphics processing unitsComputational scienceComputer architectureGraphicsComputer graphics (images)AlgorithmParallel Computing and Optimization TechniquesAdvanced Data Storage TechnologiesInterconnection Networks and Systems