Softmax-Free Linear Transformers
Jiachen Lu, Junge Zhang, Xiatian Zhu, Jianfeng Feng, Tao Xiang, Li Zhang
Topics & Concepts
Softmax functionComputer scienceDot productAlgorithmComputational complexity theoryArtificial intelligenceTheoretical computer sciencePattern recognition (psychology)MathematicsConvolutional neural networkGeometryAdvanced Neural Network ApplicationsVisual Attention and Saliency DetectionCCD and CMOS Imaging Sensors