White-Box Transformers via Sparse Rate Reduction
Sam Buchanan, Tianzhe Chu, Benjamin D. Haeffele, Yi Ma, Druv Pai, Shengbang Tong, Ziyang Wu, Yaodong Yu
Topics & Concepts
Neural Networks and Reservoir Computingstochastic dynamics and bifurcationQuantum optics and atomic interactions