openai / openai/codex

macOS Computer Use: clicks can be offset on multi-monitor setups with negative display coordinates

Open
#40,144 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

app bug computer-use
Dominant language
Rust
Stars
125k
Forks
19.4k
PR merge metrics
PR metrics pending

Description

Summary

On macOS with multiple displays, Computer Use can place the cursor visually over a target in a standard system file dialog, but the click is delivered to a different UI element.

Reproduction

  1. Use Codex Desktop on macOS with a multi-monitor arrangement where at least one display is positioned below the primary display (therefore using negative coordinates).
  2. Have Computer Use open a standard macOS save/open sheet.
  3. Ask it to select Downloads in the sheet sidebar.

Expected

The item shown beneath the cursor is selected.

Actual

The cursor was visually over Downloads, but the click selected Recents instead. Repeated attempts showed the same mismatch.

Impact

Automated UI work is unreliable in file dialogs on this display arrangement and can target an unintended destination.

Notes

This report is based on direct observation during a Codex Desktop session. The likely cause is a coordinate-space conversion issue between displays, but that is an inference rather than a confirmed root cause.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the macOS Computer Use input and coordinate-conversion entry points, then reproduce the save/open sheet scenario with a display positioned below the primary display. Done means selecting Downloads delivers the click to the item beneath the cursor rather than Recents.

Written by the indexing model from the issue text.

Assessment

Tech stack
macos, rust
Domain
desktop
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.