Is your AI getting worse? · DeepSeek
Over the last 24 hours none of the 2 DeepSeek models we track is below its recent baseline on any board, and no drift detector has fired.
Three models free · email when a watched model's coding score falls five points in a week
As of 26 Oct 2026, 11:22 UTC · 24-hour boards · per-suite Page-Hinkley detectors
01
Over the last 24 hours none of the 2 DeepSeek models we track is below its recent baseline on any board, and no drift detector has fired.
As of 26 Oct 2026, 11:22 UTC · 24-hour boards · score, then place among the ranked models; “=” marks a statistical tie
| Model | Combined | Coding | Reasoning | Tool use | Trend | Drift detectors | Tracked since |
|---|---|---|---|---|---|---|---|
| DeepSeek V4.1 Flash | 95=1 of 24 | 96=1 of 24 | 99=1 of 22 | 90=1 of 22 | stable |
| 17 May 2026 |
| DeepSeek V4 Pro | 90=1 of 24 | 87=18 of 24 | 95=1 of 22 | 91=1 of 22 | stable |
| 17 May 2026 |
Places are the leaderboard's own: walking down a board, a model joins the group above it unless that group's leader is ahead by more than the measurement can resolve, so “joint” places are normal. A detector is armed once it has ten days of daily medians on the current test version; it fires only on a sustained fall, never on one bad run. Every DeepSeek model has its own page with its history, and all of them are on DeepSeek models.
Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card.
Already have an account? Log in
02
Two different questions, answered by two different instruments.
Down is availability: every 10 minutes we send one short completion to api.deepseek.com on our own key and record whether it answered, how fast, and whose fault a failure was — the provider's, our account's, the probe's or our server's. Downgraded is quality: the scores and detectors above, from fixed tasks the API did answer. A model can be fully available and quietly worse, or briefly unavailable and unchanged.
We measure the API (api.deepseek.com), not the consumer app. The DeepSeek app is not the DeepSeek API: we probe the API, which is what applications and the Smart Router call.
The 7-day history and every episode are on DeepSeek API status; all six providers are on the status hub. When a provider stops answering, the Smart Router's fallback order moves traffic to the next model on the board.
03
The DeepSeek app and the DeepSeek API are two surfaces of the same models. The app adds its own prompt, tools and product logic; the API at api.deepseek.com is what applications call, and it is what AI Stupid Level tests — model by model, with fixed tasks, the same prompts and the same output budget every time, with nothing of yours in between.
That makes the scores a control. If the API-side scores hold and the detectors stay quiet while the DeepSeek app feels worse, the change is on the tool side: the harness, the context it assembles, or a session that has grown long enough to hurt (see context rot). If the model behind the name changes, it shows up here, on the same tasks, inside the detector's confirmation window.
04
Dated, past-tense changes in this family from the test record, September 2025 to September 2026: the same tasks before and after, with the values.
Method: daily medians of the same nine coding tasks, binary segmentation with Welch's t-test; provider builds and served model names read from the identifier each response carries. Every row, with its dates and how it was derived, is in What 13 months of monitoring LLM APIs caught.
The whole record, every vendor, is on Is your AI getting worse?; the method and its measured false-alarm rate are in How often our drift detector is wrong, measured.
05
Page-Hinkley change-point detection (a CUSUM-family test) run per suite on each model’s daily median, constants published: δ 0.01; λ 0.30 for coding and reasoning, λ 0.50 held for three consecutive daily runs for tool use; detectors run on daily medians and are armed after ten days on the current test version, so a real shift is confirmed over days, not hours. An hourly canary of two fixed probes catches sharp drops with Welch’s t-test (12-point fall, p < 0.01).
Every score carries a standard error from its own run-to-run repeatability; models whose lead is inside that noise share a place, and a composite is labelled with how many suites contributed. A prompt a provider declines is recorded as a refusal with the provider's stated category and that session's score is withheld, never imputed, so a tightened filter shows as a refusal rate rather than as invented incapability.
The detector, its constants and its measured false-alarm rate are on AI drift detection and in the methodology. The methodology is public — every weight, statistical test and drift constant. The test tasks are private, so no lab can train on them.
06
Watch the DeepSeek models you depend on and let the boards do the checking: an email when a watched model’s coding score falls five points below a week earlier, and a weekly summary of what moved. If you build on the API, the Smart Router sends each request to the model that scores best for it across every vendor on the board and is drift-aware by default, on your own provider keys.
Three models free · an email when a watched model’s coding score falls five points below a week earlier, and a weekly summary of what moved
The Smart Router routes around a model that drifts · 1,000 requests a month free · no card
The same question for the other families: Is ChatGPT getting worse?, Is Claude getting worse? and Is Gemini getting worse?. Every model on the board, with the whole record, is on Is your AI getting worse?; the DeepSeek models' scores, prices and head-to-head pages are on DeepSeek models.
07
Over the last 24 hours none of the 2 DeepSeek models we track is below its recent baseline on any board, and no drift detector has fired. The verdict reads the 24-hour boards and the per-suite Page-Hinkley detectors for every DeepSeek model on the board, re-tested on the same schedule as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe. The model-by-model table is at the top of this page.
A nerf is a deliberate change that cuts a model's cost or capability. From outside, intent is invisible; behaviour is not. Over the last 24 hours none of the 2 DeepSeek models we track is below its recent baseline on any board, and no drift detector has fired. A sustained fall on fixed tasks is what the per-suite Page-Hinkley detector is built to confirm over days; a single bad answer is not evidence, because model output varies run to run even when nothing has changed. Deliberate or not, a change behind a stable model name shows here as a change.
Because a long conversation gives the model a different problem: more context to hold, more of it stale, and the facts that matter buried in the middle. Our boards use short, fixed tasks, so they separate a change in the model from a long-session effect. How accuracy falls as the context grows — finding, linking, tracking and counting facts from 8K to 1M tokens, graded exactly — is measured on context rot.
Every DeepSeek model on the board gets the same tasks on the same schedule as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe. 2 DeepSeek models are tracked; the longest-tracked has been on the board since 17 May 2026. The methodology is public — every weight, statistical test and drift constant. The test tasks are private, so no lab can train on them. Every weight is on the methodology page.
Yes. Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card. The watchlist sends an email when a watched model’s coding score falls five points below a week earlier, and a weekly summary of what moved; paid plans tune the threshold and watch more models. Each DeepSeek model's page has a watch button, and the watchlist holds them together.
No. We test the DeepSeek API at api.deepseek.com, on our own account, with fixed tasks: what an application or the Smart Router calls, with nothing of ours in between. The DeepSeek app adds its own prompt, tools and context on top of the model, which we do not see. A model that holds steady here while the DeepSeek app feels worse points at that layer, or at a session that has grown long; see context rot and the DeepSeek API status.
Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card.
Three models free · an email when a watched model’s coding score falls five points below a week earlier, and a weekly summary of what moved
The Smart Router is drift-aware by default, on your own provider keys · 1,000 requests a month free