LUT Tensor Core: A Software-Hardware Co-Design for LUT-Based Low-Bit LLM Inference
MO Zhi-wen, Lei Wang, Jianyu Wei, Zhichen Zeng, Shijie Cao, Lingxiao Ma, Naifeng Jing, Ting Cao, Jilong Xue, Fan Yang, Mao Yang
Topics & Concepts
Computer scienceLookup tableComputer hardwareComputer architectureSoftwareBit (key)Embedded systemParallel computingProgramming languageComputer securityMagnetic confinement fusion researchAdvancements in Photolithography TechniquesParallel Computing and Optimization Techniques