Google Replaces BERT Self-Attention with Fourier Transform: 92% Accuracy, 7 Times Faster on GPUs | Synced

Transformer architectures have come to dominate the natural language processing (NLP) field since their 2017 introduction.…