LMArena agent leaderboard (cost per task / Pareto frontier)
https://lmarena.ai/leaderboard
- Kind
- benchmark
- Maintainer
- TODO
- Measures
- TODO — adopted on autopilot; to be filled after a first review.
- Does not measure
- TODO
- Known issues
- Adopted on autopilot from a pipeline proposal; kind, axes, and description not yet reviewed.
- Trust
- low
- Last reviewed
- 2026-10-07
The only agent measurement that returned real numbers this run — Claude Fable 5.1 at 14.31% and $5.43 a task, GPT-6.1 Sol at 11.23% and $0.56, with a cost-versus-quality frontier. Terminal-Bench, the existing agentic source, came back with an empty table, and nothing in the current method set pairs agent quality with price. Both the coding-agent and bulk-cheap verdicts weigh cost.