Nvidia Hopper GPU and Grace CPU Highlights

Anne C. Elster, Tor Andre Haugdahl

2022Computing in Science & Engineering69 citationsDOI

Abstract

At GTC 2022, Nvidia announced a new product family that aims to cover from small enterprise workloads through exascale high performance computing (HPC) and trillion-parameter AI models. This column highlights the most interesting features of their new Hopper graphical processing unit (GPU) and Grace central processing unit (CPU) computer chips and the Hopper product family. We also discuss some of the history behind Nvidia technologies and their most useful features for computational scientists, such as the Hopper DPX dynamic programming (DP) instruction set, increased number of SMs, and FP 8 tensor core availability. Also included are descriptions of the new Hopper Clustered SMs architecture and updated NVSwitch technologies that integrate their new ARM-based Grace CPU.

Topics & Concepts

Computer scienceCentral processing unitGraphics processing unitProduct (mathematics)Parallel computingMulti-core processorSupercomputerGeneral-purpose computing on graphics processing unitsArchitectureInstruction setCUDAOperating systemComputational scienceComputer architectureGraphicsMathematicsArtVisual artsGeometryDistributed and Parallel Computing SystemsParallel Computing and Optimization TechniquesCloud Computing and Resource Management