Frontier Research
Models, research, safety and the ideas pushing the frontier of AI
Language Models
Why teaching a model to fill in the blanks changed how machines read
By training a model to guess words hidden in a sentence using the words on both sides, Google produced a system that could be adapted to almost any language task, and it dominated the field overnight
7 min read