The quarks of attention: Structure and capacity of neural attention building blocks
Pierre Baldi, Roman Vershynin
Topics & Concepts
GatingComputer scienceArtificial neural networkMultiplicative functionQuadratic equationArtificial intelligenceTheoretical computer scienceMathematicsNeuroscienceGeometryBiologyMathematical analysisAdvanced Memory and Neural ComputingNeural dynamics and brain functionEEG and Brain-Computer Interfaces