Inter-layer Scheduling Space Definition and Exploration for Tiled Accelerators
Jingwei Cai, Yuchen Wei, Zuotong Wu, Sen Peng, Kaisheng Ma
Abstract
With the continuous expansion of the DNN accelerator scale, inter-layer scheduling, which studies the allocation of computing resources to each layer and the computing order of all layers in a DNN, plays an increasingly important role in maintaining a high utilization rate and energy efficiency of DNN inference accelerators. However, current inter-layer scheduling is mainly conducted based on some heuristic patterns. The space of inter-layer scheduling has not been clearly defined, resulting in significantly limited optimization opportunities and a lack of understanding on different inter-layer scheduling choices and their consequences.
Topics & Concepts
Computer scienceScheduling (production processes)Distributed computingInferenceFair-share schedulingTwo-level schedulingParallel computingMathematical optimizationArtificial intelligenceScheduleOperating systemMathematicsAdvanced Neural Network ApplicationsParallel Computing and Optimization TechniquesRadiation Detection and Scintillator Technologies