openai / openai/codex

[Windows Computer Use 26.901.41600] launch_app fails; Explorer screenshot shows Codex; set_value throws CacheRequest 0x80070057

Open
#43,072 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

app bug computer-use tool-calls windows-os
Dominant language
Rust
Stars
125k
Forks
19.4k
PR merge metrics
PR metrics pending

Description

Codex app version

26.901.5280.0 (installed OpenAI.Codex Appx package).

Subscription

Not included in this report.

Platform

Windows 11 25H2, build 26200.9168. Bundled Computer Use plugin: 26.901.41600, confirmed from its plugin.json. The session uses workspace-write restrictions with approved escalations. Helper process identity has not been inspected.

What issue are you seeing?

While attempting to open Steam through the bundled Windows Computer Use plugin, three problems occurred in the same session:

  1. sky.launch_app failed twice with the exact message:

    accessibility window-opened handler did not become ready
    

    Subsequent window enumeration did not show Steam, and a separate read-only process check found no Steam process.

  2. A state request for an existing File Explorer window returned a correct-looking Explorer accessibility tree (This PC, drives, address bar), but the displayed screenshot showed the Codex/ChatGPT app instead. The selected window came directly from list_windows() and was rehydrated with its returned id and app; no window handles were invented.

  3. Address-bar input did not produce an observable navigation. After re-observing and clicking the address-bar element, sky.set_value failed with:

    read UIA value read-only state: 所需属性不在 CacheRequest 中 (0x80070057)
    

    The localized portion means that the required property is not in the CacheRequest.

Steps observed

Initialize in node_repl:

globalThis.sky = (await import('@oai/sky')).sky;

Try launching the existing Steam installation:

await sky.launch_app({ app: 'D:\\application\\steam\\steam.exe' });

This was attempted twice, with window enumeration between attempts. Both returned the window-opened handler error.

For the existing Explorer window:

const windows = await sky.list_windows();
// Select exactly one returned File Explorer window titled This PC
// (localized on this machine); use its actual returned id and app.
const window = await sky.get_window({ id: selected.id, app: selected.app });
const state = await sky.get_window_state({
  window, include_screenshot: true, include_text: true
});

The accessibility tree described Explorer, while the screenshot displayed Codex. A subsequent activate_window and refreshed text state still described Explorer.

The tool reported the address bar as focused. type_text with the Steam directory path followed by a separately executed Return (with state refresh after each action) left the observed view at This PC. The address bar was then clicked using the latest accessibility index, its focused state was observed again, and:

await sky.set_value({
  window: latestState.window,
  element_index: addressBarIndexFromLatestObservation,
  value: 'D:\\application\\steam'
});

returned the CacheRequest error. Indexes were taken from refreshed observations. No terminal commands were entered through the UI.

Expected behavior
  • Launching a pre-existing application should work or return an actionable failure.
  • Screenshots and accessibility information in a state response should belong to the selected window. A mismatch should be detected rather than silently returning an unrelated app.
  • Address-bar value setting should retrieve the required UIA properties correctly, or report that the control is unsupported.
  • Input success should not be treated as proof that navigation occurred when the subsequent state does not change.
Related reports and scope
  • #37509: identical launch_app error, reported on plugin 26.803.41515.
  • #36603: correct UIA tree with screenshots of Codex, reported on plugin 26.727.51351.
  • #36335: Explorer window selection producing another application's screenshot.

This report adds observations from plugin 26.901.41600 and the address-bar set_value CacheRequest failure. It may share causes with those reports; no common root cause has been established. In particular, this session did not observe the graphics-capture 0x80070424 error from #37509, and sandbox-account ownership has not been verified here.

Screenshots are omitted because the incorrectly captured Codex window contains unrelated private conversation and project titles. No application reinstall, sandbox configuration change, or permission weakening was performed. The intended Steam uninstall was not reached.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the three reported behaviors in node_repl with the documented sky.launch_app, list_windows, get_window_state, and set_value calls. Compare the results with related issues #37509, #36603, and #36335, then trace the bundled Windows Computer Use plugin entry points. Done means each failure is isolated and the affected operation either works reliably or returns an actionable error without mismatched window data.

Written by the indexing model from the issue text.

Assessment

Domain
desktop, operating-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.