Models by vendor · OpenAI

OpenAI models on the same tests, re-tested on a fixed schedule

AI Stupid Level gives every OpenAI model on the board the same tasks as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe. The scores are ASL's own, from the 24-hour boards, never the vendor's published numbers.

Called through api.openai.com on our own account, as an application would.

8
OpenAI models on the 24-hour boards
=1st
best Combined place among the 24 ranked models, held by GPT-6 Sol
100%
of our probes to the OpenAI API answered in the last 7 days

01

How do OpenAI models score on the same tests?

8 OpenAI models are on the board. The best placed is GPT-6 Sol, joint 1st of the 24 models on the Combined board in the last 24 hours.

As of 26 Oct 2026, 11:37 UTC · 24-hour boards · score, then place in brackets; “=” marks a statistical tie

OpenAI models on the four boards over the last 24 hours. Score is the Combined board (coding 50%, reasoning 25%, tool use 25%); Coding, Reasoning and Tool use give each suite's score and place.
PlaceModelScoreTrendCodingReasoningTool use
=1GPT-6 Sol94 ± 2.2holding steady95 (=1)98 (=1)89 (=1)
=1GPT-5.6 Luna94 ± 2.2holding steady95 (=1)99 (=1)86 (=1)
=1GPT-6 Astra93 ± 2.2holding steady94 (=5)99 (=1)86 (=1)
=1GPT-5.6 Sol93 ± 2.2holding steady94 (=5)100 (=1)85 (=1)
=1GPT-6 Luna92 ± 2.3holding steady92 (=11)97 (=1)87 (=1)
=1GPT-5.6 Terra90 ± 2.3holding steady92 (=11)98 (=1)78 (=14)
=16GPT-5.582 ± 2.3holding steady94 (=5)60 (=17)78 (=14)
=16GPT-6.1 Sol81 ± 2.3holding steady93 (=5)58 (=17)81 (=14)

Places are the leaderboard's own: walking down a board, a model joins the group above it unless that group's leader is ahead by more than the measurement can resolve, so “joint” places are normal. The same boards hold every vendor's models; sign in for the full leaderboard.

See every model on every board

Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card.

Already have an account? Log in

02

Which OpenAI models are tracked?

8 OpenAI models have a page of their own, each with its place on every board and its history.

GPT-6 Sol
Tracked since 22 Sep 2026 (33 days). List price $2 per 1M input tokens and $10 per 1M output tokens. Joint 1st of the 24 models on the Combined board in the last 24 hours, scoring 94 ± 2.2.
GPT-5.6 Luna
Tracked since 17 Jul 2026. List price $0.20 per 1M input tokens and $1.20 per 1M output tokens. Joint 1st of the 24 models on the Combined board in the last 24 hours, scoring 94 ± 2.2.
GPT-6 Astra
Tracked since 5 Sep 2026 (51 days). List price $10 per 1M input tokens and $50 per 1M output tokens. Joint 1st of the 24 models on the Combined board in the last 24 hours, scoring 93 ± 2.2.
GPT-5.6 Sol
Tracked since 17 Jul 2026. List price $4 per 1M input tokens and $20 per 1M output tokens. Joint 1st of the 24 models on the Combined board in the last 24 hours, scoring 93 ± 2.2.
GPT-6 Luna
Tracked since 22 Sep 2026 (33 days). List price $0.10 per 1M input tokens and $0.50 per 1M output tokens. Joint 1st of the 24 models on the Combined board in the last 24 hours, scoring 92 ± 2.3.
GPT-5.6 Terra
Tracked since 17 Jul 2026. List price $2 per 1M input tokens and $12 per 1M output tokens. Joint 1st of the 24 models on the Combined board in the last 24 hours, scoring 90 ± 2.3.
GPT-5.5
Tracked since 27 Apr 2026 (182 days). List price $5 per 1M input tokens and $30 per 1M output tokens. Joint 16th of the 24 models on the Combined board in the last 24 hours, scoring 82 ± 2.3.
GPT-6.1 Sol
Tracked since 29 Sep 2026. List price $2 per 1M input tokens and $10 per 1M output tokens. Joint 16th of the 24 models on the Combined board in the last 24 hours, scoring 81 ± 2.3.

Prices are list prices per 1M tokens on api.openai.com, cache-miss rate, as the leaderboard's price view quotes them. What a correct result costs over the last 30 days is on the best-value AI model; response times are on the fastest AI model.

03

Which OpenAI model is best for coding right now?

On the Coding board, re-tested every four hours, the best-placed OpenAI model in the last 24 hours is GPT-5.6 Luna: joint 1st of the 24 models on the Coding board in the last 24 hours, scoring 95 ± 0.5. Next among OpenAI models is GPT-6 Sol, joint 1st of the 24 models on the Coding board in the last 24 hours.

The coding suite gives a model a small working project and a bug report (7 tasks a sweep) and grades the fix by running the project's own tests, including hidden tests the model never sees. Every vendor's models get the same tasks: see the best LLM for coding across all vendors and how coding is scored.

Let the router pick the best-placed model

One OpenAI-compatible endpoint, your own provider keys, 1,000 requests a month free · no card

04

Which OpenAI model is best for reasoning?

On the Reasoning board, re-tested daily, the best-placed OpenAI model in the last 24 hours is GPT-5.6 Sol: joint 1st of the 22 models on the Reasoning board in the last 24 hours, scoring 100 ± 2.5. Next among OpenAI models is GPT-5.6 Luna, joint 1st of the 22 models on the Reasoning board in the last 24 hours.

The reasoning suite runs 4 long multi-turn working sessions a day, scored on correctness, recovery after a failed step and continuity: whether the model still honours rules stated earlier in the session, checked by running code rather than by a judge model. See the best LLM for reasoning across all vendors and how reasoning is scored.

05

Which OpenAI model is best for agents and tool calling?

On the Tool use board, re-tested daily, the best-placed OpenAI model in the last 24 hours is GPT-6 Sol: joint 1st of the 22 models on the Tool use board in the last 24 hours, scoring 89 ± 2.5. Next among OpenAI models is GPT-6 Luna, joint 1st of the 22 models on the Tool use board in the last 24 hours.

The tool-use suite runs 9 tasks in sandboxed machines, each with tools to call: either the job is done at the end or it is not. It is scored on task completion, tool selection, parameter accuracy, efficiency, error handling, context awareness and safety. See the best AI model for agents across all vendors and how tool use is scored.

06

Is the OpenAI API down?

One short completion on our own key, from one machine in Germany. Checked every 10 minutes: what an application calling api.openai.com would see.

Status
Answering
Answered
100% of checks in the last 24 hours · 100% over the last 7 days
Median response
1,342 ms to one short completion on our own key
Last checked
26 Oct 2026, 11:40 UTC · checked every 10 minutes
  • Answered
  • Slow
  • Did not answer
  • Our side, not counted
  • No check

The 7-day history, every episode and the other five providers are on OpenAI API status and the provider status hub. When a provider stops answering, the Smart Router's fallback order moves traffic to the next model on the board.

Route around an outage

Fallback order across every vendor on the board · 1,000 requests a month free · no card

07

Is ChatGPT getting worse?

ChatGPT is not the OpenAI API: we probe the API, which is what applications and the Smart Router call. A provider can change a model behind the same API name, and without continuous re-testing that change is invisible to the people relying on it. AI Stupid Level compares each OpenAI model with its own past: every suite has its own Page-Hinkley (a CUSUM-family test) change-point detector, which separates a sustained decline from ordinary run-to-run noise, and the hourly canary probe watches for a sudden collapse. On the Combined board over the last 24 hours, of the 8 OpenAI models with a current score, 8 are holding steady. Searches for “is ChatGPT getting worse” and “AI model nerfed” end at the same place: the current answer, model by model, is on Is ChatGPT getting worse?, and the method is on AI drift detection.

Watch an OpenAI model

Free alerts: an email when a watched model's coding score falls five points in a week · 3 models on a free account

09

How we test OpenAI models

Every model on the board gets the same tasks on the same schedule: coding every four hours, reasoning and tool use daily, with an hourly canary probe. OpenAI models are called through api.openai.com on our own account, exactly as an application would call them, so a score describes the model as it is served, not as it was announced.

The coding suite (7 tasks) grades a bug fix by running the project's own tests, including hidden tests the model never sees. The reasoning suite (4 sessions) scores long multi-turn working sessions on correctness, recovery and continuity. The tool-use suite (9 tasks) runs in sandboxed machines, where the job is either done or not. The Combined score weights coding 50%, reasoning 25% and tool use 25%.

The methodology is public — every weight, statistical test and drift constant. The test tasks are private, so no lab can train on them. Read the methodology and how drift detection works.

10

Questions people ask about OpenAI models

How many OpenAI models does AI Stupid Level benchmark?

8 OpenAI models are on the board: GPT-6 Sol, GPT-5.6 Luna, GPT-6 Astra, GPT-5.6 Sol, GPT-6 Luna, GPT-5.6 Terra, GPT-5.5 and GPT-6.1 Sol. Each is called through api.openai.com on our own account and gets the same tasks as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe.

Which OpenAI model has the highest Combined score?

GPT-6 Sol: 94 ± 2.2, joint 1st of the 24 models on the Combined board in the last 24 hours. Next among OpenAI models is GPT-5.6 Luna at 94 ± 2.2, joint 1st of the 24 models on the Combined board in the last 24 hours. The Combined score weights coding 50%, reasoning 25% and tool use 25%; "joint" means the models sharing a place are closer than the measurement can separate.

Which OpenAI model is best for coding?

GPT-5.6 Luna: joint 1st of the 24 models on the Coding board in the last 24 hours, scoring 95 ± 0.5. The coding suite is re-tested every four hours and graded by running the project's own tests, including hidden tests the model never sees. Every vendor's models are on the best LLM for coding.

Which OpenAI model is the cheapest?

By list price, GPT-6 Luna: $0.10 per 1M input tokens and $0.50 per 1M output tokens, against $10 and $50 for GPT-6 Astra. List prices are the cache-miss rate on api.openai.com. What a correct result costs is a different question, answered over the last 30 days on the best-value AI model.

Is the OpenAI API down?

As of 26 Oct 2026, 11:40 UTC the OpenAI API was answering our probe; 100% of checks in the last 24 hours and 100% over the last 7 days answered. We check every 10 minutes: one short completion on our own key, from one machine in Germany. The 7-day history and every episode are on OpenAI API status.

Is ChatGPT getting worse?

ChatGPT is not the OpenAI API: we probe the API, which is what applications and the Smart Router call. Each OpenAI model on the board is compared with its own past: every suite has its own Page-Hinkley (a CUSUM-family test) change-point detector, which separates a sustained decline from ordinary run-to-run noise. On the Combined board over the last 24 hours, of the 8 OpenAI models with a current score, 8 are holding steady. The current answer, model by model, is on Is ChatGPT getting worse?.

How often are OpenAI models re-tested?

On the same schedule as every other vendor's models: coding every four hours, reasoning and tool use daily, with an hourly canary probe. The methodology is public — every weight, statistical test and drift constant. The test tasks are private, so no lab can train on them. Every weight is on the methodology page.

Watch OpenAI models, or let the router choose

Free account: every ranking over 24 hours, 7 days and 30 days, a 3-model watchlist with email alerts, 1,000 routed requests a month and a Data API key. No card.

Watch an OpenAI model

Free alerts: an email when a watched model's coding score falls five points in a week.

Let the router pick the best-placed model

Routes across every vendor on the board, on your own provider keys · 1,000 requests a month free