Windows Computer Use cannot activate D5 Render window despite reading accessibility tree
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 125k
- Forks
- 19.4k
- PR merge metrics
- PR metrics pending
Description
Problem
Computer Use in the Codex/ChatGPT desktop app on Windows detects D5 Render and reads its accessibility tree, including the open project's title and imported model, but cannot activate the window or send clicks. This prevents continuing a rendering workflow.
Reproduction observed in this session
- Open D5 Render with a project (also reproduced in an empty scene).
- Initialize the bundled Computer Use integration with
@oai/sky. - Use
sky.list_windows()and select the unique returned D5 Render window. - Rehydrate it using
sky.get_window({ id, app }), preserving the returned identifiers. - Call
sky.activate_window({ window }).
Actual result: failed to activate captured window.
Expected result: D5 becomes active and subsequent supported input actions work.
Additional observations
sky.get_window_state({ window, include_screenshot: false, include_text: true })can read the D5 accessibility tree. The tree includesServiceApplication.MainWindowand a nestedServiceApplication.CExternalWindow.- An indexed click on the imported model returned
coordinate input geometry is unavailable. - The exposed accessibility
Raiseaction also returnedfailed to activate captured window. - Some screenshot requests targeting D5 showed the foreground ChatGPT app instead of D5; other requests showed D5.
- Activating SketchUp 2024 succeeded in the same diagnostic session.
- The failure persisted after refreshing window identifiers, resetting the JavaScript automation session, restarting D5, restarting Codex, and rebooting Windows. A fresh D5 window ID after restart did not resolve it.
Environment
- Windows laptop (exact Windows build not collected).
- D5 Launcher displayed version 3.1.1 for Render.
- Bundled Computer Use plugin path version:
26.903.71938. - Exact desktop app version not collected.
- Root cause is unknown; no claim of a confirmed permission or rendering-engine cause.
Feedback reference
Feedback was submitted through the app. Feedback ID: 01a08b8b-63ca-7ba3-8194-97c327a56d9f.
Please investigate D5 window targeting/activation compatibility and advise on a supported fix. Project files and private filesystem paths are omitted.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the @oai/sky entry points listed in the report: list_windows(), get_window(), activate_window(), and get_window_state(). Compare D5 Render with the successful SketchUp 2024 activation, including accessibility actions and screenshot targeting. Done means D5 activates reliably and subsequent supported input actions work.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript
- Domain
- desktop, operating-systems
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100