openai / openai/codex

Windows Computer Use cannot activate D5 Render window despite reading accessibility tree

Open
#44,543 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

app bug computer-use windows-os
Dominant language
Rust
Stars
125k
Forks
19.4k
PR merge metrics
PR metrics pending

Description

Problem

Computer Use in the Codex/ChatGPT desktop app on Windows detects D5 Render and reads its accessibility tree, including the open project's title and imported model, but cannot activate the window or send clicks. This prevents continuing a rendering workflow.

Reproduction observed in this session

  1. Open D5 Render with a project (also reproduced in an empty scene).
  2. Initialize the bundled Computer Use integration with @oai/sky.
  3. Use sky.list_windows() and select the unique returned D5 Render window.
  4. Rehydrate it using sky.get_window({ id, app }), preserving the returned identifiers.
  5. Call sky.activate_window({ window }).

Actual result: failed to activate captured window.
Expected result: D5 becomes active and subsequent supported input actions work.

Additional observations

  • sky.get_window_state({ window, include_screenshot: false, include_text: true }) can read the D5 accessibility tree. The tree includes ServiceApplication.MainWindow and a nested ServiceApplication.CExternalWindow.
  • An indexed click on the imported model returned coordinate input geometry is unavailable.
  • The exposed accessibility Raise action also returned failed to activate captured window.
  • Some screenshot requests targeting D5 showed the foreground ChatGPT app instead of D5; other requests showed D5.
  • Activating SketchUp 2024 succeeded in the same diagnostic session.
  • The failure persisted after refreshing window identifiers, resetting the JavaScript automation session, restarting D5, restarting Codex, and rebooting Windows. A fresh D5 window ID after restart did not resolve it.

Environment

  • Windows laptop (exact Windows build not collected).
  • D5 Launcher displayed version 3.1.1 for Render.
  • Bundled Computer Use plugin path version: 26.903.71938.
  • Exact desktop app version not collected.
  • Root cause is unknown; no claim of a confirmed permission or rendering-engine cause.

Feedback reference

Feedback was submitted through the app. Feedback ID: 01a08b8b-63ca-7ba3-8194-97c327a56d9f.

Please investigate D5 window targeting/activation compatibility and advise on a supported fix. Project files and private filesystem paths are omitted.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the @oai/sky entry points listed in the report: list_windows(), get_window(), activate_window(), and get_window_state(). Compare D5 Render with the successful SketchUp 2024 activation, including accessibility actions and screenshot targeting. Done means D5 activates reliably and subsequent supported input actions work.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
desktop, operating-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.