Mmastodon TechnologySoftware first seen 5 h ago, last 5 h ago, peak #3
New AI models claim agentic coding skills, benchmarks questioned
Original: Every few weeks a new model lands on Hugging Face with a specific claim: post-trained for agentic coding, tuned for tool
Every few weeks a new language model arrives on Hugging Face with claims of being post-trained for agentic coding, tuned for tool use, and optimized for terminal workflows. Developers note the published benchmark numbers are real, but they are aggregate scores over large curated task sets, which may not reflect how the models perform on individual, real-world coding jobs.
Why now: A rapid stream of new models marketed for agentic coding is prompting debate about whether their benchmark scores reflect real-world usefulness.
Evidence
- Every few weeks a new model lands on Hugging Face with a specific claim: post-trained for agentic coding, tuned for tool use, optimized for terminal workflows. The benchmark numbers that come with these releases are real, but they're aggregate scores over huge, curated task… · hackaday@www.urbanmind.net · 3
API: https://socialmediatrends-api.osmike.com/v1/trends/520857