DOSA: Differentiable Model-Based One-Loop Search for DNN Accelerators
C. Hong, Qijing Huang, Grace Dinh, Mahesh Subedar, Yakun Sophia Shao
Abstract
In the hardware design space exploration process, it is critical to optimize both hardware parameters and algorithm-to-hardware mappings. Previous work has largely approached this simultaneous optimization problem by separately exploring the hardware design space and the mapspace—both individually large and highly nonconvex spaces—independently. The resulting combinatorial explosion has created significant difficulties for optimizers.
Topics & Concepts
Computer scienceProcess (computing)Loop (graph theory)Differentiable functionSpace (punctuation)Work (physics)Hardware accelerationComputer hardwareParallel computingComputer engineeringMathematical optimizationComputer architectureProgramming languageMathematicsOperating systemField-programmable gate arrayEngineeringPure mathematicsMechanical engineeringCombinatoricsVLSI and FPGA Design TechniquesEmbedded Systems Design TechniquesParallel Computing and Optimization Techniques