haesleinhuepf / haesleinhuepf/git-bob
Halucinations in reviews
Open
- Dominant language
- Python
- Stars
- 71
- Forks
- 15
- PR merge metrics
- No merged PRs in 30d
Description
git-bob halucinates: E.g. it [claims](https://github.com/haesleinhuepf/git-bob/pull/70) to have tested code, which is certainly not true.
Contributor guide
No contributing guide indexed for this repository
Research direction
Begin with the concrete example in pull request #70 and trace how git-bob produces review claims about testing. No source files or tests are named, so first identify the review entry point and reproduce the unsupported claim. Done means reviews no longer assert that code was tested when it was not.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100