AI Change Tracker

AA-LCR v1.1 (Artificial Analysis long-context reasoning)

https://artificialanalysis.ai/models

Kind
benchmark
Maintainer
TODO
Measures
TODO — adopted on autopilot; to be filled after a first review.
Does not measure
TODO
Known issues
Adopted on autopilot from a pipeline proposal; kind, axes, and description not yet reviewed.
Trust
low
Last reviewed
2026-10-07

Fiction.liveBench, the only current source behind the long_context axis used by both the coding-agent and hard-problems verdicts, returned no usable benchmark table this run — that axis effectively has no working source right now. AA-LCR is a live eval already inside Artificial Analysis Intelligence Index v4.3.2 measuring the same thing, giving long_context a second, working source. Approving because it fills a real gap in what the verdicts can currently measure, not just because a new benchmark exists. No per-model AA-LCR scores were available this run, so there's nothing to apply yet beyond starting to track the method.

← All methods