Models by vendor · DeepSeek
AI Stupid Level gives every DeepSeek model on the board the same tasks as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe. The scores are ASL's own, from the 24-hour boards, never the vendor's published numbers.
Called through api.deepseek.com on our own account, as an application would.
01
2 DeepSeek models are on the board. The best placed is DeepSeek V4.1 Flash, joint 1st of the 24 models on the Combined board in the last 24 hours.
As of 26 Oct 2026, 11:37 UTC · 24-hour boards · score, then place in brackets; “=” marks a statistical tie
| Place | Model | Score | Trend | Coding | Reasoning | Tool use |
|---|---|---|---|---|---|---|
| =1 | DeepSeek V4.1 Flash | 95 ± 2.2 | holding steady | 96 (=1) | 99 (=1) | 90 (=1) |
| =1 | DeepSeek V4 Pro | 90 ± 2.2 | holding steady | 87 (=18) | 95 (=1) | 91 (=1) |
Places are the leaderboard's own: walking down a board, a model joins the group above it unless that group's leader is ahead by more than the measurement can resolve, so “joint” places are normal. The same boards hold every vendor's models; sign in for the full leaderboard.
Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card.
Already have an account? Log in
02
2 DeepSeek models have a page of their own, each with its place on every board and its history.
Prices are list prices per 1M tokens on api.deepseek.com, cache-miss rate, as the leaderboard's price view quotes them. What a correct result costs over the last 30 days is on the best-value AI model; response times are on the fastest AI model.
03
On the Coding board, re-tested every four hours, the best-placed DeepSeek model in the last 24 hours is DeepSeek V4.1 Flash: joint 1st of the 24 models on the Coding board in the last 24 hours, scoring 96 ± 0.3. Next among DeepSeek models is DeepSeek V4 Pro, joint 18th of the 24 models on the Coding board in the last 24 hours.
The coding suite gives a model a small working project and a bug report (7 tasks a sweep) and grades the fix by running the project's own tests, including hidden tests the model never sees. Every vendor's models get the same tasks: see the best LLM for coding across all vendors and how coding is scored.
One OpenAI-compatible endpoint, your own provider keys, 1,000 requests a month free · no card
04
On the Reasoning board, re-tested daily, the best-placed DeepSeek model in the last 24 hours is DeepSeek V4.1 Flash: joint 1st of the 22 models on the Reasoning board in the last 24 hours, scoring 99 ± 2.5. Next among DeepSeek models is DeepSeek V4 Pro, joint 1st of the 22 models on the Reasoning board in the last 24 hours.
The reasoning suite runs 4 long multi-turn working sessions a day, scored on correctness, recovery after a failed step and continuity: whether the model still honours rules stated earlier in the session, checked by running code rather than by a judge model. See the best LLM for reasoning across all vendors and how reasoning is scored.
05
On the Tool use board, re-tested daily, the best-placed DeepSeek model in the last 24 hours is DeepSeek V4 Pro: joint 1st of the 22 models on the Tool use board in the last 24 hours, scoring 91 ± 2.5. Next among DeepSeek models is DeepSeek V4.1 Flash, joint 1st of the 22 models on the Tool use board in the last 24 hours.
The tool-use suite runs 9 tasks in sandboxed machines, each with tools to call: either the job is done at the end or it is not. It is scored on task completion, tool selection, parameter accuracy, efficiency, error handling, context awareness and safety. See the best AI model for agents across all vendors and how tool use is scored.
06
One short completion on our own key, from one machine in Germany. Checked every 10 minutes: what an application calling api.deepseek.com would see.
The 7-day history, every episode and the other five providers are on DeepSeek API status and the provider status hub. When a provider stops answering, the Smart Router's fallback order moves traffic to the next model on the board.
Fallback order across every vendor on the board · 1,000 requests a month free · no card
07
The DeepSeek app is not the DeepSeek API: we probe the API, which is what applications and the Smart Router call. A provider can change a model behind the same API name, and without continuous re-testing that change is invisible to the people relying on it. AI Stupid Level compares each DeepSeek model with its own past: every suite has its own Page-Hinkley (a CUSUM-family test) change-point detector, which separates a sustained decline from ordinary run-to-run noise, and the hourly canary probe watches for a sudden collapse. On the Combined board over the last 24 hours, of the 2 DeepSeek models with a current score, 2 are holding steady. Searches for “is DeepSeek getting worse” and “AI model nerfed” end at the same place: the current answer, model by model, is on Is DeepSeek getting worse?, and the method is on AI drift detection.
Free alerts: an email when a watched model's coding score falls five points in a week · 3 models on a free account
08
Every pair page puts two models side by side, board by board, on the same tests over the last 24 hours.
DeepSeek V4.1 Flash, the best-placed DeepSeek model on the Combined board, against each other vendor's best-placed model:
Other vendors on the same tests: OpenAI models, Anthropic models, Google models, Moonshot AI (Kimi) models and Z.ai (GLM) models. The compare hub lists every family, and the best AI model ranks them across vendors.
09
Every model on the board gets the same tasks on the same schedule: coding every four hours, reasoning and tool use daily, with an hourly canary probe. DeepSeek models are called through api.deepseek.com on our own account, exactly as an application would call them, so a score describes the model as it is served, not as it was announced.
The coding suite (7 tasks) grades a bug fix by running the project's own tests, including hidden tests the model never sees. The reasoning suite (4 sessions) scores long multi-turn working sessions on correctness, recovery and continuity. The tool-use suite (9 tasks) runs in sandboxed machines, where the job is either done or not. The Combined score weights coding 50%, reasoning 25% and tool use 25%.
The methodology is public — every weight, statistical test and drift constant. The test tasks are private, so no lab can train on them. Read the methodology and how drift detection works.
10
2 DeepSeek models are on the board: DeepSeek V4.1 Flash and DeepSeek V4 Pro. Each is called through api.deepseek.com on our own account and gets the same tasks as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe.
DeepSeek V4.1 Flash: 95 ± 2.2, joint 1st of the 24 models on the Combined board in the last 24 hours. Next among DeepSeek models is DeepSeek V4 Pro at 90 ± 2.2, joint 1st of the 24 models on the Combined board in the last 24 hours. The Combined score weights coding 50%, reasoning 25% and tool use 25%; "joint" means the models sharing a place are closer than the measurement can separate.
DeepSeek V4.1 Flash: joint 1st of the 24 models on the Coding board in the last 24 hours, scoring 96 ± 0.3. The coding suite is re-tested every four hours and graded by running the project's own tests, including hidden tests the model never sees. Every vendor's models are on the best LLM for coding.
By list price, DeepSeek V4.1 Flash: $0.30 per 1M input tokens and $1.20 per 1M output tokens, against $1.32 and $3.96 for DeepSeek V4 Pro. List prices are the cache-miss rate on api.deepseek.com. What a correct result costs is a different question, answered over the last 30 days on the best-value AI model.
As of 26 Oct 2026, 11:40 UTC the DeepSeek API was answering our probe; 100% of checks in the last 24 hours and 100% over the last 7 days answered. We check every 10 minutes: one short completion on our own key, from one machine in Germany. The 7-day history and every episode are on DeepSeek API status.
The DeepSeek app is not the DeepSeek API: we probe the API, which is what applications and the Smart Router call. Each DeepSeek model on the board is compared with its own past: every suite has its own Page-Hinkley (a CUSUM-family test) change-point detector, which separates a sustained decline from ordinary run-to-run noise. On the Combined board over the last 24 hours, of the 2 DeepSeek models with a current score, 2 are holding steady. The current answer, model by model, is on Is DeepSeek getting worse?.
On the same schedule as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe. The methodology is public — every weight, statistical test and drift constant. The test tasks are private, so no lab can train on them. Every weight is on the methodology page.
Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card.
Free alerts: an email when a watched model's coding score falls five points in a week.
Routes across every vendor on the board, on your own provider keys · 1,000 requests a month free