web-infra-dev / web-infra-dev/midscene

[Bug]: Element positioning exceeds the screen size

Open
#2,929 0 comments 0 reactions 1 assignee View on GitHub

@EAGzzyCSL is already working on this.

Since Aug 12, 2026.

Dominant language
TypeScript
Stars
14.9k
Forks
1.2k
Avg merge
1d 14h
Merged PRs (30d)
96

Description

Version
System:
    OS: macOS 14.1.1
    CPU: (8) arm64 Apple M2
    Memory: 135.94 MB / 16.00 GB
    Shell: 5.9 - /bin/zsh
  Browsers:
    Chrome: 150.0.7871.188
    Safari: 17.1
Details

task runner is in error state, cannot append task
error=ServiceError: failed to locate element:
Failed to parse locate result: locate result coordinates [62,3268,698,3438] exceed image size [0, 1440]x[0, 3200]. shape=bbox order=xy limits=[1440,3200,1440,3200]
ServiceError: failed to locate element:
Failed to parse locate result: locate result coordinates [62,3268,698,3438] exceed image size [0, 1440]x[0, 3200]. shape=bbox order=xy limits=[1440,3200,1440,3200]
at Service.locate (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/service/index.js:107:29)
at processTicksAndRejections (node:internal/process/task_queues:104:5)
at Object.executor (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/agent/task-builder.js:291:36)
at TaskRunner.flush (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/task-runner.js:186:35)
at TaskExecutor.runAction (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/agent/tasks.js:366:17)
at runAiAct (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/agent/agent.js:463:46)
at AndroidAgent.aiAct (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/agent/agent.js:496:22)
at executeAction (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/playground/dist/lib/common.js:210:20)
at /Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/playground/dist/lib/server.js:2159:35

Reproduce link

no

Reproduce Steps

使用的是桌面版midscene,发现在点击边缘元素时常出现这个问题,模型用的是gpt-5.6

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.