Is your AI getting worse? · Google

Is Gemini getting worse?

Over the last 24 hours none of the 3 Gemini models we track is below its recent baseline on any board, and no drift detector has fired.

Watch a Gemini model

Three models free · email when a watched model's coding score falls five points in a week

As of 26 Oct 2026, 11:22 UTC · 24-hour boards · per-suite Page-Hinkley detectors

3
Gemini models on the same tests as every other vendor's models
6 of 7
per-suite drift detectors armed with no detection
100%
of our probes to generativelanguage.googleapis.com answered in the last 7 days

01

Is Gemini nerfed right now?

Over the last 24 hours none of the 3 Gemini models we track is below its recent baseline on any board, and no drift detector has fired.

As of 26 Oct 2026, 11:22 UTC · 24-hour boards · score, then place among the ranked models; “=” marks a statistical tie

Gemini models on the four boards over the last 24 hours, with the state of each model's Page-Hinkley detector per suite and the day it was first tracked.
ModelCombinedCodingReasoningTool useTrendDrift detectorsTracked since
Gemini 3.8 Flash89=1 of 2491=11 of 2498=1 of 2277=14 of 22stable
  • Coding armed, no detection
  • Reasoning armed, no detection
  • Tool use armed, no detection
5 Sep 2026
Gemini 3.5 Flash Lite86=16 of 2485=22 of 2496=1 of 2278=14 of 22stable
  • Coding armed, no detection
  • Reasoning armed, no detection
  • Tool use armed, no detection
5 Sep 2026
Gemini 4 Argon6524 of 246524 of 24stable
  • Coding younger than ten days
  • Reasoning no baseline yet
  • Tool use no baseline yet
13 Oct 2026
Gemini 3.8 Flash
Holding steady on the 24-hour boards (joint 1st of 24 on Combined); detectors armed on coding, reasoning and tool use with no detection; tracked since 5 Sep 2026.
Gemini 3.5 Flash Lite
Holding steady on the 24-hour boards (joint 16th of 24 on Combined); detectors armed on coding, reasoning and tool use with no detection; tracked since 5 Sep 2026.
Gemini 4 Argon
Holding steady on the 24-hour boards (24th of 24 on Combined); coding younger than ten days; tracked since 13 Oct 2026.

Places are the leaderboard's own: walking down a board, a model joins the group above it unless that group's leader is ahead by more than the measurement can resolve, so “joint” places are normal. A detector is armed once it has ten days of daily medians on the current test version; it fires only on a sustained fall, never on one bad run. Every Gemini model has its own page with its history, and all of them are on Google models.

See every model on every board

Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card.

Already have an account? Log in

02

Has Gemini been downgraded, or is it down?

Two different questions, answered by two different instruments.

Down is availability: every 10 minutes we send one short completion to generativelanguage.googleapis.com on our own key and record whether it answered, how fast, and whose fault a failure was — the provider's, our account's, the probe's or our server's. Downgraded is quality: the scores and detectors above, from fixed tasks the API did answer. A model can be fully available and quietly worse, or briefly unavailable and unchanged.

We measure the API (generativelanguage.googleapis.com), not the consumer app. The Gemini app is not the Gemini API: we probe the API, which is what applications and the Smart Router call.

Status
Answering
Answered
100% of checks in the last 24 hours · 100% over the last 7 days
Median response
590 ms to one short completion on our own key
Last checked
26 Oct 2026, 11:30 UTC · checked every 10 minutes

The 7-day history and every episode are on Google API status; all six providers are on the status hub. When a provider stops answering, the Smart Router's fallback order moves traffic to the next model on the board.

03

The Gemini app vs the Gemini API

The Gemini app and the Gemini API are two surfaces of the same models. The app adds its own prompt, tools and product logic; the API at generativelanguage.googleapis.com is what applications call, and it is what AI Stupid Level tests — model by model, with fixed tasks, the same prompts and the same output budget every time, with nothing of yours in between.

That makes the scores a control. If the API-side scores hold and the detectors stay quiet while the Gemini app feels worse, the change is on the tool side: the harness, the context it assembles, or a session that has grown long enough to hurt (see context rot). If the model behind the name changes, it shows up here, on the same tasks, inside the detector's confirmation window.

04

What changed in the record

Dated, past-tense changes in this family from the test record, September 2025 to September 2026: the same tasks before and after, with the values.

· Gemini 2.5 Pro (preview 03-25)
Endpoint withdrawn: answering (last successful run 9 Nov 2025) → HTTP 404 from 2 Dec 2025. For an application that hard-codes a model name, a withdrawal looks exactly like an outage.
· Gemini 2.5 Flash
Response time on the same tasks: 1.4 s → 1.0 s (−28%). An isolated serving-speed step with no change on our side; the pass rate on the same tasks did not step with it.
· Gemini 2.5 Pro (preview 03-25)
Response time on the same tasks: 5.3 s → 3.8 s (−28%). An isolated serving-speed step with no change on our side; the pass rate on the same tasks did not step with it.

Method: daily medians of the same nine coding tasks, binary segmentation with Welch's t-test; provider builds and served model names read from the identifier each response carries. Withdrawals are read from the per-call record: a last successful call, then HTTP 404 on every later attempt. Every row, with its dates and how it was derived, is in What 13 months of monitoring LLM APIs caught.

The whole record, every vendor, is on Is your AI getting worse?; the method and its measured false-alarm rate are in How often our drift detector is wrong, measured.

05

How we tell a real change from noise

Page-Hinkley change-point detection (a CUSUM-family test) run per suite on each model’s daily median, constants published: δ 0.01; λ 0.30 for coding and reasoning, λ 0.50 held for three consecutive daily runs for tool use; detectors run on daily medians and are armed after ten days on the current test version, so a real shift is confirmed over days, not hours. An hourly canary of two fixed probes catches sharp drops with Welch’s t-test (12-point fall, p < 0.01).

Every score carries a standard error from its own run-to-run repeatability; models whose lead is inside that noise share a place, and a composite is labelled with how many suites contributed. A prompt a provider declines is recorded as a refusal with the provider's stated category and that session's score is withheld, never imputed, so a tightened filter shows as a refusal rate rather than as invented incapability.

The detector, its constants and its measured false-alarm rate are on AI drift detection and in the methodology. The methodology is public — every weight, statistical test and drift constant. The test tasks are private, so no lab can train on them.

06

What to do

Watch the Gemini models you depend on and let the boards do the checking: an email when a watched model’s coding score falls five points below a week earlier, and a weekly summary of what moved. If you build on the API, the Smart Router sends each request to the model that scores best for it across every vendor on the board and is drift-aware by default, on your own provider keys.

Watch a Gemini model

Three models free · an email when a watched model’s coding score falls five points below a week earlier, and a weekly summary of what moved

Route around a model that drifts

The Smart Router routes around a model that drifts · 1,000 requests a month free · no card

The same question for the other families: Is ChatGPT getting worse?, Is Claude getting worse? and Is DeepSeek getting worse?. Every model on the board, with the whole record, is on Is your AI getting worse?; the Gemini models' scores, prices and head-to-head pages are on Google models.

07

Questions people ask about Gemini

Is Gemini getting worse?

Over the last 24 hours none of the 3 Gemini models we track is below its recent baseline on any board, and no drift detector has fired. The verdict reads the 24-hour boards and the per-suite Page-Hinkley detectors for every Gemini model on the board, re-tested on the same schedule as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe. The model-by-model table is at the top of this page.

Is Gemini nerfed?

A nerf is a deliberate change that cuts a model's cost or capability. From outside, intent is invisible; behaviour is not. Over the last 24 hours none of the 3 Gemini models we track is below its recent baseline on any board, and no drift detector has fired. A sustained fall on fixed tasks is what the per-suite Page-Hinkley detector is built to confirm over days; a single bad answer is not evidence, because model output varies run to run even when nothing has changed. Deliberate or not, a change behind a stable model name shows here as a change.

Why does Gemini seem dumber in long sessions?

Because a long conversation gives the model a different problem: more context to hold, more of it stale, and the facts that matter buried in the middle. Our boards use short, fixed tasks, so they separate a change in the model from a long-session effect. How accuracy falls as the context grows — finding, linking, tracking and counting facts from 8K to 1M tokens, graded exactly — is measured on context rot.

How often do you test Gemini?

Every Gemini model on the board gets the same tasks on the same schedule as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe. 3 Gemini models are tracked; the longest-tracked has been on the board since 5 Sep 2026. The methodology is public — every weight, statistical test and drift constant. The test tasks are private, so no lab can train on them. Every weight is on the methodology page.

Can I get an alert when Gemini changes?

Yes. Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card. The watchlist sends an email when a watched model’s coding score falls five points below a week earlier, and a weekly summary of what moved; paid plans tune the threshold and watch more models. Each Gemini model's page has a watch button, and the watchlist holds them together.

Do you test the Gemini app itself?

No. We test the Google API at generativelanguage.googleapis.com, on our own account, with fixed tasks: what an application or the Smart Router calls, with nothing of ours in between. The Gemini app adds its own prompt, tools and context on top of the model, which we do not see. A model that holds steady here while the Gemini app feels worse points at that layer, or at a session that has grown long; see context rot and the Google API status.

Know the next time Gemini changes

Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card.

Watch a Gemini model

Three models free · an email when a watched model’s coding score falls five points below a week earlier, and a weekly summary of what moved

Route around a model that drifts

The Smart Router is drift-aware by default, on your own provider keys · 1,000 requests a month free