Efficient Combination of Rematerialization and Offloading for Training DNNs
Olivier Beaumont, Lionel Eyraud‐Dubois, Alena Shilova
2021HAL (Le Centre pour la Communication Scientifique Directe)15 citations
Abstract
International audience
Topics & Concepts
Computer scienceOverhead (engineering)ComputationArtificial intelligenceDeep learningArtificial neural networkDeep neural networksMemory managementComputer engineeringDistributed computingMachine learningParallel computingAlgorithmSemiconductor memoryComputer hardwareOperating systemStochastic Gradient Optimization TechniquesAdvanced Neural Network ApplicationsFerroelectric and Negative Capacitance Devices