Mmastodon TechnologySemiconductors first seen 4 d ago, last 4 d ago, peak #4

SemiAnalysis launches GDPx benchmark for AI agents, Opus 5.5 leads

Original: SemiAnalysis's new GDPx benchmark tests AI agents across 11 domains, from chip design to cybersecurity. Opus 5.5 tops it

Research firm SemiAnalysis has introduced GDPx, a new benchmark that evaluates AI agents across 11 professional domains, ranging from chip design to cybersecurity. Anthropic's Opus 5.5 tops the leaderboard, but with a score of just 12%, highlighting how far AI agents remain from expert-level performance on demanding real-world tasks. The low ceiling and breadth of tested domains are drawing attention from AI practitioners discussing how it compares with existing benchmarks and what the results say about current agent capabilities.

Why now: A new benchmark with a strikingly low top score offers fresh evidence of the current limits of AI agents, prompting debate.

SemiAnalysisAnthropicOpus 5.5GDPx

Open on mastodon →

Evidence

• SemiAnalysis's new GDPx benchmark tests AI agents across 11 domains, from chip design to cybersecurity. Opus 5.5 tops it at just 12%. How it works: benchmarks and leaderboards. # Benchmarks # AIAgents # Semiconductors # Cybersecurity # AI https:// tokenmaxradar.com Sources… · Tokenmaxradar

API: https://socialmediatrends-api.osmike.com/v1/trends/4608385