AI and ML Accelerator Survey and Trends
Albert Reuther, Peter Michaleas, Michael Jones, Vijay Gadepally, Siddharth Samsi, Jeremy Kepner
Abstract
This paper updates the survey of AI accelerators and processors from past three years. This paper collects and summarizes the current commercial accelerators that have been publicly announced with peak performance and power consumption numbers. The performance and power values are plotted on a scatter graph, and a number of dimensions and observations from the trends on this plot are again discussed and analyzed. Two new trends plots based on accelerator release dates are included in this year's paper, along with the additional trends of some neuromorphic, photonic, and memristor-based inference accelerators.
Topics & Concepts
Neuromorphic engineeringComputer sciencePower consumptionPlot (graphics)InferenceMemristorGraphPower (physics)Artificial intelligenceElectrical engineeringArtificial neural networkEngineeringStatisticsTheoretical computer sciencePhysicsMathematicsQuantum mechanicsAdvanced Memory and Neural ComputingCCD and CMOS Imaging SensorsNeural Networks and Reservoir Computing