Linear Transformers Get a Learnable Kernel: Does Flexformer Change the Efficiency Tradeoff?
Flexformer makes linear attention's kernel learnable by training spectral frequencies, but the abstract offers no perplexity or accuracy numbers to back its gains.
