Yhn BusinessEconomy first seen 1 d ago, last 3 h ago, peak #11
Why didn't we get GPT-2 in 2005?
A new essay argues that the ingredients behind GPT-2 — transformers aside, large language models might have been feasible nearly two decades earlier — prompting debate over what actually held AI back: compute, data, or ideas. Readers are weighing whether progress was gated by hardware costs and the lack of internet-scale text corpora, or whether researchers simply lacked the imagination to scale simple methods sooner.
Why now: The essay challenges assumptions about why AI progress took as long as it did, sparking debate among technologists about missed opportunities.
Evidence
- Why didn't we get GPT-2 in 2005? · bilsbie · 23
API: https://socialmediatrends-api.osmike.com/v1/trends/899472