OpenHands / OpenHands/extensions

PR bot installation should support multiple versions, so we can easily compare

Open
#182 2 comments 0 reactions 1 assignee View on GitHub

@juanmichelini is already working on this.

Since Apr 15, 2026.

Dominant language
Python
Stars
148
Forks
90
Avg merge
1d 17h
Merged PRs (30d)
36

Description

We should be able to install in a repo a single PR bot as we do now.
But activate multiple versions.

Then when the bot is first run on a review a version is randomly selected.
Re reviews would use same version.

Laminar traces should track which version was used.

This will allow us to quickly compare similar versions of the PR review bot in similar environments getting an accurate measure of

suggestion_accuracy = ai_suggestions_reflected / ai_suggestions

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.