hardmaru on Twitter: "Reformer: The Efficient Transformer They present techniques to reduce the time and memory complexity of Transformer, allowing batches of very long sequences (64K) to fit on one GPU. Should
![NLP Newsletter: Reformer, DeepMath, ELECTRA, TinyBERT for Search, VizSeq, Open-Sourcing ML,… | by elvis | DAIR.AI | Medium NLP Newsletter: Reformer, DeepMath, ELECTRA, TinyBERT for Search, VizSeq, Open-Sourcing ML,… | by elvis | DAIR.AI | Medium](https://miro.medium.com/v2/resize:fit:1200/1*mgWc3FhHPRfCxdPir6wSeg.png)
NLP Newsletter: Reformer, DeepMath, ELECTRA, TinyBERT for Search, VizSeq, Open-Sourcing ML,… | by elvis | DAIR.AI | Medium
![💡Illustrating the Reformer. 🚊 ️ The efficient Transformer | by Alireza Dirafzoon | Towards Data Science 💡Illustrating the Reformer. 🚊 ️ The efficient Transformer | by Alireza Dirafzoon | Towards Data Science](https://miro.medium.com/v2/resize:fit:1400/1*gP3LvhmH9fV5qpAPfy4H0w.png)
💡Illustrating the Reformer. 🚊 ️ The efficient Transformer | by Alireza Dirafzoon | Towards Data Science
![💡Illustrating the Reformer. 🚊 ️ The efficient Transformer | by Alireza Dirafzoon | Towards Data Science 💡Illustrating the Reformer. 🚊 ️ The efficient Transformer | by Alireza Dirafzoon | Towards Data Science](https://miro.medium.com/v2/resize:fit:1392/1*fN4ck7Jd0gDilFeAZhowpA.gif)
💡Illustrating the Reformer. 🚊 ️ The efficient Transformer | by Alireza Dirafzoon | Towards Data Science
![Reformer: The Efficient Transformer", Anonymous et al 2019 {G} [handling sequences up to L=64k on 1 GPU] : r/MachineLearning Reformer: The Efficient Transformer", Anonymous et al 2019 {G} [handling sequences up to L=64k on 1 GPU] : r/MachineLearning](https://external-preview.redd.it/X0iUTaLs2Nk1xsiLuHSXDEF24fJPyIBmmpqk4epPlYg.jpg?auto=webp&s=036dcf53a951d6bafbf5c2dd6b37ccf914dabf13)
Reformer: The Efficient Transformer", Anonymous et al 2019 {G} [handling sequences up to L=64k on 1 GPU] : r/MachineLearning
![💡Illustrating the Reformer. 🚊 ️ The efficient Transformer | by Alireza Dirafzoon | Towards Data Science 💡Illustrating the Reformer. 🚊 ️ The efficient Transformer | by Alireza Dirafzoon | Towards Data Science](https://miro.medium.com/v2/resize:fit:1400/1*ifCm7OLNDi5liHo87ECEzA.png)
💡Illustrating the Reformer. 🚊 ️ The efficient Transformer | by Alireza Dirafzoon | Towards Data Science
![💡Illustrating the Reformer. 🚊 ️ The efficient Transformer | by Alireza Dirafzoon | Towards Data Science 💡Illustrating the Reformer. 🚊 ️ The efficient Transformer | by Alireza Dirafzoon | Towards Data Science](https://miro.medium.com/v2/resize:fit:1052/1*aArg6a26KqbIlEkT43fxlw.gif)