🏢 MIT FutureTech
Algorithmic progress in language models
·4934 words·24 mins·
loading
·
loading
AI Generated
Natural Language Processing
Large Language Models
🏢 MIT FutureTech
Language model algorithms have improved drastically, halving compute needs every 8 months since 2012, surpassing Moore’s Law; however, compute scaling, not algorithms, drove most recent performance ga…