Models by vendor · Anthropic
Claude models on the same tests, re-tested on a fixed schedule
AI Stupid Level gives every Claude model on the board the same tasks as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe. The scores are ASL's own, from the 24-hour boards, never the vendor's published numbers.
Called through api.anthropic.com on our own account, as an application would.
- 9
- Claude models on the 24-hour boards
- =1st
- best Combined place among the 24 ranked models, held by Claude Opus 5.5
- 100%
- of our probes to the Anthropic API answered in the last 7 days
01
How do Claude models score on the same tests?
9 Claude models are on the board. The best placed is Claude Opus 5.5, joint 1st of the 24 models on the Combined board in the last 24 hours.
As of 26 Oct 2026, 11:37 UTC · 24-hour boards · score, then place in brackets; “=” marks a statistical tie
| Place | Model | Score | Trend | Coding | Reasoning | Tool use |
|---|---|---|---|---|---|---|
| =1 | Claude Opus 5.5 | 94 ± 2.3 | holding steady | 95 (=1) | 99 (=1) | 86 (=1) |
| =1 | Claude Sonnet 5.5 | 92 ± 2.2 | holding steady | 93 (=5) | 97 (=1) | 86 (=1) |
| =1 | Claude Fable 5.1 | 91 ± 2.2 | holding steady | 87 (=18) | 100 (=1) | 90 (=1) |
| =1 | Claude Opus 5 | 90 ± 2.2 | holding steady | 87 (=18) | 98 (=1) | 89 (=1) |
| =1 | Claude Sonnet 5 | 89 ± 2.2 | holding steady | 89 (=16) | 90 (=15) | 88 (=1) |
| =20 | Claude Opus 4.8 | 78 ± 2.3 | holding steady | 88 (=18) | 59 (=17) | 78 (=14) |
| =20 | Claude Opus 4.7 | 78 ± 2.2 | holding steady | 93 (=5) | 53 (=20) | 72 (=20) |
| =20 | Claude Opus 4.6 | 76 ± 2.2 | holding steady | 91 (=11) | 52 (=20) | 70 (=20) |
| =20 | Claude Sonnet 4.6 | 74 ± 2.3 | holding steady | 90 (=11) | 46 (22) | 70 (=20) |
Places are the leaderboard's own: walking down a board, a model joins the group above it unless that group's leader is ahead by more than the measurement can resolve, so “joint” places are normal. The same boards hold every vendor's models; sign in for the full leaderboard.
Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card.
Already have an account? Log in
02
Which Claude models are tracked?
9 Anthropic models have a page of their own, each with its place on every board and its history.
- Claude Opus 5.5
- Tracked since 22 Sep 2026 (33 days). List price $4 per 1M input tokens and $20 per 1M output tokens. Joint 1st of the 24 models on the Combined board in the last 24 hours, scoring 94 ± 2.3.
- Claude Sonnet 5.5
- Tracked since 28 Sep 2026. List price $2 per 1M input tokens and $10 per 1M output tokens. Joint 1st of the 24 models on the Combined board in the last 24 hours, scoring 92 ± 2.2.
- Claude Fable 5.1
- Tracked since 2 Sep 2026. List price $10 per 1M input tokens and $50 per 1M output tokens. Joint 1st of the 24 models on the Combined board in the last 24 hours, scoring 91 ± 2.2.
- Claude Opus 5
- Tracked since 25 Jul 2026. List price $5 per 1M input tokens and $25 per 1M output tokens. Joint 1st of the 24 models on the Combined board in the last 24 hours, scoring 90 ± 2.2.
- Claude Sonnet 5
- Tracked since 1 Jul 2026 (117 days). List price $2 per 1M input tokens and $10 per 1M output tokens. Joint 1st of the 24 models on the Combined board in the last 24 hours, scoring 89 ± 2.2.
- Claude Opus 4.8
- Tracked since 29 May 2026 (150 days). List price $5 per 1M input tokens and $25 per 1M output tokens. Joint 20th of the 24 models on the Combined board in the last 24 hours, scoring 78 ± 2.3.
- Claude Opus 4.7
- Tracked since 17 Apr 2026 (191 days). List price $5 per 1M input tokens and $25 per 1M output tokens. Joint 20th of the 24 models on the Combined board in the last 24 hours, scoring 78 ± 2.2.
- Claude Opus 4.6
- Tracked since 6 Feb 2026 (262 days). List price $5 per 1M input tokens and $25 per 1M output tokens. Joint 20th of the 24 models on the Combined board in the last 24 hours, scoring 76 ± 2.2.
- Claude Sonnet 4.6
- Tracked since 18 Feb 2026 (250 days). List price $3 per 1M input tokens and $15 per 1M output tokens. Joint 20th of the 24 models on the Combined board in the last 24 hours, scoring 74 ± 2.3.
Prices are list prices per 1M tokens on api.anthropic.com, cache-miss rate, as the leaderboard's price view quotes them. What a correct result costs over the last 30 days is on the best-value AI model; response times are on the fastest AI model.
03
Which Claude model is best for coding right now?
On the Coding board, re-tested every four hours, the best-placed Claude model in the last 24 hours is Claude Opus 5.5: joint 1st of the 24 models on the Coding board in the last 24 hours, scoring 95 ± 1.2. Next among Claude models is Claude Opus 4.7, joint 5th of the 24 models on the Coding board in the last 24 hours.
The coding suite gives a model a small working project and a bug report (7 tasks a sweep) and grades the fix by running the project's own tests, including hidden tests the model never sees. Every vendor's models get the same tasks: see the best LLM for coding across all vendors and how coding is scored.
One OpenAI-compatible endpoint, your own provider keys, 1,000 requests a month free · no card
04
Which Claude model is best for reasoning?
On the Reasoning board, re-tested daily, the best-placed Claude model in the last 24 hours is Claude Fable 5.1: joint 1st of the 22 models on the Reasoning board in the last 24 hours, scoring 100 ± 2.5. Next among Claude models is Claude Opus 5.5, joint 1st of the 22 models on the Reasoning board in the last 24 hours.
The reasoning suite runs 4 long multi-turn working sessions a day, scored on correctness, recovery after a failed step and continuity: whether the model still honours rules stated earlier in the session, checked by running code rather than by a judge model. See the best LLM for reasoning across all vendors and how reasoning is scored.
05
Which Claude model is best for agents and tool calling?
On the Tool use board, re-tested daily, the best-placed Claude model in the last 24 hours is Claude Fable 5.1: joint 1st of the 22 models on the Tool use board in the last 24 hours, scoring 90 ± 2.5. Next among Claude models is Claude Opus 5, joint 1st of the 22 models on the Tool use board in the last 24 hours.
The tool-use suite runs 9 tasks in sandboxed machines, each with tools to call: either the job is done at the end or it is not. It is scored on task completion, tool selection, parameter accuracy, efficiency, error handling, context awareness and safety. See the best AI model for agents across all vendors and how tool use is scored.
06
Is the Anthropic API down?
One short completion on our own key, from one machine in Germany. Checked every 10 minutes: what an application calling api.anthropic.com would see.
- Status
- Answering
- Answered
- 100% of checks in the last 24 hours · 100% over the last 7 days
- Median response
- 1,172 ms to one short completion on our own key
- Last checked
- 26 Oct 2026, 11:40 UTC · checked every 10 minutes
The 7-day history, every episode and the other five providers are on Anthropic API status and the provider status hub. When a provider stops answering, the Smart Router's fallback order moves traffic to the next model on the board.
Fallback order across every vendor on the board · 1,000 requests a month free · no card
07
Is Claude getting worse?
The Claude app is not the Anthropic API: we probe the API, which is what applications and the Smart Router call. A provider can change a model behind the same API name, and without continuous re-testing that change is invisible to the people relying on it. AI Stupid Level compares each Claude model with its own past: every suite has its own Page-Hinkley (a CUSUM-family test) change-point detector, which separates a sustained decline from ordinary run-to-run noise, and the hourly canary probe watches for a sudden collapse. On the Combined board over the last 24 hours, of the 9 Claude models with a current score, 9 are holding steady. Searches for “is Claude getting worse” and “AI model nerfed” end at the same place: the current answer, model by model, is on Is Claude getting worse?, and the method is on AI drift detection.
Free alerts: an email when a watched model's coding score falls five points in a week · 3 models on a free account
08
Compare Claude models
Every pair page puts two models side by side, board by board, on the same tests over the last 24 hours.
Claude Opus 5.5, the best-placed Claude model on the Combined board, against each other vendor's best-placed model:
Other vendors on the same tests: OpenAI models, Google models, DeepSeek models, Moonshot AI (Kimi) models and Z.ai (GLM) models. The compare hub lists every family, and the best AI model ranks them across vendors.
09
How we test Claude models
Every model on the board gets the same tasks on the same schedule: coding every four hours, reasoning and tool use daily, with an hourly canary probe. Claude models are called through api.anthropic.com on our own account, exactly as an application would call them, so a score describes the model as it is served, not as it was announced.
The coding suite (7 tasks) grades a bug fix by running the project's own tests, including hidden tests the model never sees. The reasoning suite (4 sessions) scores long multi-turn working sessions on correctness, recovery and continuity. The tool-use suite (9 tasks) runs in sandboxed machines, where the job is either done or not. The Combined score weights coding 50%, reasoning 25% and tool use 25%.
The methodology is public — every weight, statistical test and drift constant. The test tasks are private, so no lab can train on them. Read the methodology and how drift detection works.
10
Questions people ask about Claude models
How many Claude models does AI Stupid Level benchmark?
9 Anthropic models are on the board: Claude Opus 5.5, Claude Sonnet 5.5, Claude Fable 5.1, Claude Opus 5, Claude Sonnet 5, Claude Opus 4.8, Claude Opus 4.7, Claude Opus 4.6 and Claude Sonnet 4.6. Each is called through api.anthropic.com on our own account and gets the same tasks as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe.
Which Claude model has the highest Combined score?
Claude Opus 5.5: 94 ± 2.3, joint 1st of the 24 models on the Combined board in the last 24 hours. Next among Claude models is Claude Sonnet 5.5 at 92 ± 2.2, joint 1st of the 24 models on the Combined board in the last 24 hours. The Combined score weights coding 50%, reasoning 25% and tool use 25%; "joint" means the models sharing a place are closer than the measurement can separate.
Which Claude model is best for coding?
Claude Opus 5.5: joint 1st of the 24 models on the Coding board in the last 24 hours, scoring 95 ± 1.2. The coding suite is re-tested every four hours and graded by running the project's own tests, including hidden tests the model never sees. Every vendor's models are on the best LLM for coding.
Which Claude model is the cheapest?
By list price, Claude Sonnet 5.5: $2 per 1M input tokens and $10 per 1M output tokens, against $10 and $50 for Claude Fable 5.1. List prices are the cache-miss rate on api.anthropic.com. What a correct result costs is a different question, answered over the last 30 days on the best-value AI model.
Is the Anthropic API down?
As of 26 Oct 2026, 11:40 UTC the Anthropic API was answering our probe; 100% of checks in the last 24 hours and 100% over the last 7 days answered. We check every 10 minutes: one short completion on our own key, from one machine in Germany. The 7-day history and every episode are on Anthropic API status.
Is Claude getting worse?
The Claude app is not the Anthropic API: we probe the API, which is what applications and the Smart Router call. Each Claude model on the board is compared with its own past: every suite has its own Page-Hinkley (a CUSUM-family test) change-point detector, which separates a sustained decline from ordinary run-to-run noise. On the Combined board over the last 24 hours, of the 9 Claude models with a current score, 9 are holding steady. The current answer, model by model, is on Is Claude getting worse?.
How often are Claude models re-tested?
On the same schedule as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe. The methodology is public — every weight, statistical test and drift constant. The test tasks are private, so no lab can train on them. Every weight is on the methodology page.
Watch Claude models, or let the router choose
Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card.
Free alerts: an email when a watched model's coding score falls five points in a week.
Routes across every vendor on the board, on your own provider keys · 1,000 requests a month free