macOS Computer Use: clicks can be offset on multi-monitor setups with negative display coordinates
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 125k
- Forks
- 19.4k
- PR merge metrics
- PR metrics pending
Description
Summary
On macOS with multiple displays, Computer Use can place the cursor visually over a target in a standard system file dialog, but the click is delivered to a different UI element.
Reproduction
- Use Codex Desktop on macOS with a multi-monitor arrangement where at least one display is positioned below the primary display (therefore using negative coordinates).
- Have Computer Use open a standard macOS save/open sheet.
- Ask it to select
Downloadsin the sheet sidebar.
Expected
The item shown beneath the cursor is selected.
Actual
The cursor was visually over Downloads, but the click selected Recents instead. Repeated attempts showed the same mismatch.
Impact
Automated UI work is unreliable in file dialogs on this display arrangement and can target an unintended destination.
Notes
This report is based on direct observation during a Codex Desktop session. The likely cause is a coordinate-space conversion issue between displays, but that is an inference rather than a confirmed root cause.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the macOS Computer Use input and coordinate-conversion entry points, then reproduce the save/open sheet scenario with a display positioned below the primary display. Done means selecting Downloads delivers the click to the item beneath the cursor rather than Recents.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- macos, rust
- Domain
- desktop
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100