Last test Sep 25 · next test Sep 26
Did they nerf it? Daily degradation checks.
Same test, every day, through the public API. Each model is only ever compared with its own first week.
Claude Haiku 4.5Anthropic · openrouter/anthropic/claude-haiku-4.5@anthropic · low
48%Right on its latest run, Sep 25. 1 run so far.
Baseline date: Sep 25, 2026. Released Oct 15, 2025.Verdict from Oct 2
Claude Opus 5.5Anthropic · openrouter/anthropic/claude-opus-5.5@anthropic · low
94%Right on its latest run, Sep 25. 1 run so far.
Baseline date: Sep 25, 2026.Verdict from Oct 2
Claude Sonnet 5Anthropic · openrouter/anthropic/claude-sonnet-5@anthropic · low
70%Right on its latest run, Sep 25. 1 run so far.
Baseline date: Sep 25, 2026. Released Jun 30.Verdict from Oct 2
Get an alert when a model gets nerfed
One email when a verdict changes. Nothing else.