Sometimes — and usually without notice. Providers change weights, safety layers and serving infrastructure behind the same model name. AI Stupid Level re-runs the same tasks on every model on a fixed schedule and compares each one with its own history, so a drop shows up as data instead of a hunch. Is your AI getting worse? gives the answer by provider.

Check the record: is ChatGPT getting worse and is Claude getting worse each read the drift detectors and the 24-hour board for that family. Every OpenAI and Anthropic model we track is re-tested on coding every 4 hours and on reasoning and tool use every day, and a model is flagged only when a change holds up statistically — not after one bad run.

What we paid the provider, at its list price, for every attempt at a task, divided by the attempts that passed the hidden tests. A model that is cheap per token but fails often can cost more per correct result than a pricier one that gets it right, so this is the number that tells you what the work really costs.

It changes, which is the point. The leaderboard ranks every model we track on real repository bug fixes every 4 hours — which model is best for coding shows the 24-hour board — and the router’s auto-coding mode sends your request to the current leader among the models you have keys for.

It routes on measured quality, not just price and uptime. Rankings come from our own continuous benchmarks, drift-flagged models drop behind healthy ones, and every response explains its pick in an X-AISM-Reasoning header. You keep your own provider keys and pay providers directly.

Yes. A workload assessment runs up to 20 of your real tasks on three models in our harness, with a report in 7 business days. Our team can also build a custom benchmark around your workflow, run it continuously alongside our public suites, and connect it to your Smart Router, so your requests keep going to the model that is best on your work.

No. Requests are sent with your own provider keys and billed to you by the provider at their list price. Plans include a monthly number of routed requests; past that you can top up credits or move up a plan.

OpenAI, Anthropic, Google, DeepSeek, Moonshot AI (Kimi) and Z.ai (GLM). The router handles text, code and tool calls. It does not route images or audio, because we do not measure them and will not route what we do not measure.

A free account costs nothing and includes every category ranking over the last 24 hours, 7 days and 30 days, a three-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. The newest run, as it lands, is part of the paid plans. Model pages, the methodology and the status page stay open to everyone.