Intel Gaudi 3 AI Accelerator: Architected for Gen AI Training and Inference
Roman Kaplan
Abstract
•OAM: Open Compute Platform Acceleration Module •2 compute dies connected over an interposer bridge •8 HBM2e stacks •Up to 900W with air cooling •Up to 1200W with liquid cooling •PCIe Gen5×16 •24x 200GbE RoCE via 48 112G PAM4 Serdes
Topics & Concepts
Computer scienceInferenceArtificial intelligenceTraining (meteorology)Operating systemParallel computingPhysicsMeteorologyEvolutionary Algorithms and ApplicationsRobotics and Automated Systems