microsoft / microsoft/GUI-Agent-RL

Why the final result (task success rate) is so low ?

Open
#6 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
44
Forks
4
PR merge metrics
No merged PRs in 30d

Description

Hi Author,

        From your paper, you public task success rate only ~20%. why the result is so low.

From Digirl/DigiQ paper , which publish their result maybe ~ 60% task success rate.

Image

Image

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the paper's reported task success rate and the DigiRL/DigiQ results cited in the issue. The issue does not name any repository files, tests, or entry points; done would be an author explanation of why the reported results differ.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.