GPT-2

A new essay asks why large language models like GPT-2 weren't built roughly fifteen years before they actually appeared. It examines whether the underlying ideas, computing hardware, and data were available by the mid-2000s, and what that implies about how predictable technological progress really is. Readers are debating whether the delay came from missing insights, limited compute, or simple lack of imagination.