openai / openai/codex

Paginated thread bootstrap loads up to 500 items without a byte limit, so one large turn remains slow

Open
#38,653 5 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

app app-server bug iOS performance remote
Dominant language
Rust
Stars
125k
Forks
19.5k
PR merge metrics
PR metrics pending

Description

Summary

A converted paginated task can still take tens of seconds to open because Codex Desktop uses a count-based initial item budget. It loads up to 500 recent items, without a byte-size limit.

One recent turn can therefore fill almost the complete initial window with large commandExecution items. Pagination prevents old history from loading, but it does not make the task interactive quickly.

The same remote task was slow in Codex Desktop on macOS and in Codex mobile. Mobile sometimes reported:

Error loading messages: Codex request timed out.

Environment

  • Codex Desktop: 26.810.41047, build 6570
  • Platform: macOS, Apple Silicon
  • Task host: remote Linux App Server over SSH
  • Mobile used a separate reverse-tunnel route to the same remote App Server
  • The task was confirmed as historyMode: "paginated"

Private task IDs, host names, paths, prompts, and outputs are omitted.

Reproduction shape

The affected task had:

  • rollout size: about 48.9 MiB
  • 37 turns
  • 974 persisted display items
  • about 14.1 MiB of serialized display-item data
  • latest completed turn: 420 items and about 10.8 MiB
  • commandExecution: 207 items and about 13.3 MiB across the task

Cold-load observations:

  • stable thread/resume: about 0.26 seconds
  • cold desktop hydration: about 28.8 seconds
  • warm cached reopen: about 1.1 seconds
  • ten sequential thread/items/list requests were observed during the cold load
  • some attempts reached the client timeout at about 65 seconds
  • mobile also had long waits and a request-timeout error

This points to the initial item payload and client hydration, not rollout parsing or SQLite query time.

Desktop source finding

The installed Desktop bundle has a paginated tail-hydration path that:

  1. requests the newest five turns with itemsView: "notLoaded";
  2. calls thread/items/list repeatedly;
  3. uses a shared budget of min(requested turn limit, 5) * 100, which is 500 items for the initial five-turn request;
  4. asks for up to 100 items per item request;
  5. stops at 500 items or when the selected turns are exhausted;
  6. keeps cursors for older items.

The bundle also prevents the legacy full-history background drain for paginated tasks. The problem is therefore not that pagination is ignored. The problem is that the initial budget is based only on item count.

In this case, the newest 420-item turn alone contained about 10.8 MiB, so it remained almost fully inside the 500-item bootstrap window.

Expected behavior

A paginated task should become interactive after a small, byte-bounded bootstrap response, even when the newest turn contains many large command outputs.

The client should show the newest user and assistant messages quickly. Large command output and reasoning detail should load only when needed, or use compact placeholders.

Suggested direction

  • Add a byte-size budget to initial item hydration.
  • Use a much smaller initial item window when serialized items are large.
  • Load full command output only when the user expands or scrolls to it.
  • Keep user messages, assistant messages, file changes, turn status, and active output in the fast path.
  • Do not block the composer or active-turn status on old command-output hydration.
  • Apply the same bounded behavior to remote/follower and mobile paths.

Suggested regression test

Create a paginated fixture where the newest turn contains about 400 items and more than 10 MiB of command output.

Verify that:

  1. the first interactive render transfers a bounded payload;
  2. the composer becomes usable without loading all large output items;
  3. the complete output remains available on demand;
  4. desktop and remote/follower clients do not reach their request timeout;
  5. the original rollout and model-visible context remain unchanged.

Related issues

  • #21211 — broad eager history hydration and renderer performance
  • #34663 — CLI/TUI full-history resume behavior
  • #33786 — repeated large-thread replay on Desktop

This report is narrower than those issues: it reproduces after the task is already converted to paginated history, and it identifies the 500-item, count-only bootstrap budget as the remaining large-payload path.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the paginated tail-hydration path that requests the newest five turns and applies the 500-item shared budget, then inspect its existing item-list and cursor handling. Use the proposed fixture with about 400 items and more than 10 MiB of command output. Done means the first render has a bounded payload, the composer is usable without loading all output, complete output remains available on demand, and original rollout and model-visible context are unchanged.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
desktop-dev, mobile-dev, performance
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.