DCT-Former: Efficient Self-Attention with Discrete Cosine Transform
Carmelo Scribano, Giorgia Franchini, Marco Prato, Marko Bertogna
Topics & Concepts
Discrete cosine transformMemory footprintJPEGComputer scienceTheoretical computer scienceComputationAlgorithmLossy compressionArithmeticComputer engineeringData compressionArtificial intelligenceMathematicsImage (mathematics)Operating systemAdvanced Data Compression TechniquesAlgorithms and Data CompressionTensor decomposition and applications