TelaMalloc: Efficient On-Chip Memory Allocation for Production Machine Learning Accelerators
Martin Maas, Ulysse Beaugnon, Arun Chauhan, Berkin Ilbeyi
Abstract
Memory buffer allocation for on-chip memories is a major challenge in modern machine learning systems that target ML accelerators.
Topics & Concepts
Computer scienceLimitingChipProduction (economics)Path (computing)Critical path methodQuality (philosophy)Embedded systemComputer architectureOperating systemEngineeringTelecommunicationsSystems engineeringEpistemologyEconomicsMacroeconomicsMechanical engineeringPhilosophyParallel Computing and Optimization TechniquesFerroelectric and Negative Capacitance DevicesAdvanced Neural Network Applications