web-infra-dev / web-infra-dev/midscene
[Bug]: Element positioning exceeds the screen size
@EAGzzyCSL is already working on this.
Since Aug 12, 2026.
- Dominant language
- TypeScript
- Stars
- 14.9k
- Forks
- 1.2k
- Avg merge
- 1d 14h
- Merged PRs (30d)
- 96
Description
Version
System:
OS: macOS 14.1.1
CPU: (8) arm64 Apple M2
Memory: 135.94 MB / 16.00 GB
Shell: 5.9 - /bin/zsh
Browsers:
Chrome: 150.0.7871.188
Safari: 17.1
Details
task runner is in error state, cannot append task
error=ServiceError: failed to locate element:
Failed to parse locate result: locate result coordinates [62,3268,698,3438] exceed image size [0, 1440]x[0, 3200]. shape=bbox order=xy limits=[1440,3200,1440,3200]
ServiceError: failed to locate element:
Failed to parse locate result: locate result coordinates [62,3268,698,3438] exceed image size [0, 1440]x[0, 3200]. shape=bbox order=xy limits=[1440,3200,1440,3200]
at Service.locate (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/service/index.js:107:29)
at processTicksAndRejections (node:internal/process/task_queues:104:5)
at Object.executor (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/agent/task-builder.js:291:36)
at TaskRunner.flush (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/task-runner.js:186:35)
at TaskExecutor.runAction (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/agent/tasks.js:366:17)
at runAiAct (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/agent/agent.js:463:46)
at AndroidAgent.aiAct (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/core/dist/lib/agent/agent.js:496:22)
at executeAction (/Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/playground/dist/lib/common.js:210:20)
at /Applications/Midscene Studio Beta.app/Contents/Resources/app.asar/node_modules/@midscene/playground/dist/lib/server.js:2159:35
Reproduce link
no
Reproduce Steps
使用的是桌面版midscene,发现在点击边缘元素时常出现这个问题,模型用的是gpt-5.6
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.