openai / openai/codex

Codex Luna quota consumption appears ~4–5x higher than Aug 31 under the same model and max reasoning effort

Open
#45,867 6 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

app bug rate-limits
Dominant language
Rust
Stars
125k
Forks
19.4k
PR merge metrics
PR metrics pending

Description

I am seeing a very large regression/change in Codex quota consumption for GPT-5.6 Luna.

This does not appear to be explained by task complexity, a switch to Astra, or reasoning effort alone. I compared local rollout JSONL telemetry from Aug 31, Sep 15, and Sep 16.

Environment:

  • Plan: Plus
  • Model: gpt-5.6-luna
  • Reasoning effort: max
  • Codex context window: 258,400
  • Workloads: repository inspection, implementation/review, documentation alignment, tool calls
  • Most input tokens are cached context in both the old and new samples.

Aug 31 baseline:
I have three Luna Max rollout files from Aug 31.

Combined raw input across those three files:

  • ~62.86M input tokens
  • ~61.40M cached input tokens
  • ~97.7% of input was cached

One relatively clean Aug 31 Luna Max sample went from:

  • 5h quota used: 45% -> 77%
  • raw input: ~0.024M -> 27.001M

That is approximately:

~843K raw input tokens per 1% of 5h quota

This is actually a lower bound because the quota header is account-wide and other Codex activity was also occurring during that interval.

My desktop usage counter for Aug 31 showed approximately 324M tokens for the day, and I was still able to work normally without the kind of quota exhaustion I see now.

Sep 15 / Sep 16 behavior:
With the same gpt-5.6-luna model at max reasoning effort, I am now observing roughly:

~200K–270K raw input tokens per 1% of 5h quota

On Sep 16, a Luna Max documentation/repository alignment session produced approximately:

  • 24.35M total input tokens
  • 23.45M cached input tokens
  • 902K non-cached input tokens
  • 71K output tokens

The Codex UI showed approximately 973K tokens, which corresponds almost exactly to:

non-cached input + output

The UI therefore did not expose the ~23.45M cached input being repeatedly processed.

During the relevant part of this Sep 16 session, the 5h quota moved approximately:

27% -> 82%

The effective rate was about:

~202K raw input tokens per 1% of 5h quota

Compared with the Aug 31 Luna Max sample (~843K/1%), this is at least a ~4.2x reduction in effective quota throughput for the same model and reasoning effort.

The Sep 15 Luna Max samples already showed the same ~200K–270K/1% behavior, so this does not appear to be a one-off Sep 16 anomaly.

Additional observations:

  1. Cached-context replay dominates the traffic.
    In the Sep 16 session, ~96–97% of the model input was cached input. Many tool-loop responses repeatedly sent ~100K+ context.

  2. Quota accounting appears asynchronous.
    I observed cases where the 5h used percentage increased even though the recorded total token count had not increased between adjacent telemetry records.

    I also saw a jump from 5% to 27% after an idle period, on a response containing only ~30K input tokens, which strongly suggests delayed quota posting/accounting.

  3. This was not caused by an Astra worker.
    The Sep 16 main thread remained gpt-5.6-luna at max reasoning effort. There was an automatic guardian/review thread, but its traffic was far too small to explain the observed quota change.

  4. Reasoning effort does affect cost, but does not explain the longitudinal regression.
    On Sep 15, Luna Medium subagents appeared substantially cheaper (~0.8M–1.2M raw input/1%), while Luna Max was ~0.2M–0.27M/1%.
    However, Aug 31 Luna Max itself was already capable of ~0.84M raw input/1% or better. Therefore the Aug -> Sep change cannot be explained simply by Max reasoning being expensive.

Please investigate whether there has been a change or regression in:

  • subscription quota weighting for cached input;
  • Luna Max quota multipliers;
  • server-side rate-limit/accounting logic;
  • delayed quota reconciliation;
  • cached-context replay accounting;
  • or the relationship between the UI token counter and actual quota consumption.

If the quota weighting was intentionally changed, please document it clearly. The practical difference is large enough to change whether a Plus/Pro subscription is viable for sustained Codex development work.

A sanitized JSONL log information in CSV format is attached for evidence review.

codex-quota-telemetry-summary.csv

Possibly related: #43811

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the attached codex-quota-telemetry-summary.csv and the comparison details in this issue, then read the discussion in related issue #43811. Reconcile the reported token totals, quota changes, and delayed updates across the dated samples. Done means identifying whether the behavior is an accounting regression or an intentional weighting change, with the relevant behavior documented.

Written by the indexing model from the issue text.

Assessment

Domain
backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.