OPTIMUS: OPTImized matrix MUltiplication Structure for Transformer neural network accelerator
Junki Park, Hyunsung Yoon, Daehyun Ahn, Jungwook Choi, Jae‐Joon Kim
2020Proceedings of Machine Learning and Systems24 citations
Abstract
This research was supported by the MSIT(Ministry of Science and ICT), Korea, under the ICT Consilience Creative program (IITP-2019-2011-1-00783) supervised by the IITP(Institute for Information & communications Technology Promotion).
Topics & Concepts
TransformerMultiplication (music)Artificial neural networkComputer scienceElectrical engineeringEngineeringArtificial intelligenceMathematicsVoltageCombinatoricsNeural Networks and ApplicationsComputational Physics and Python ApplicationsParallel Computing and Optimization Techniques