ASSERT-KTH / ASSERT-KTH/repairbench-framework
reference performance of AI models on coding tasks
Open
- Dominant language
- Python
- Stars
- 22
- Forks
- 10
- PR merge metrics
- No merged PRs in 30d
Description
we copy-paste notable coding leaderboard snapshots, with source
this will be useful to argue for the choice of models in our future papers.
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no file, test, or entry point. First locate where benchmark or model references are maintained, then review the existing format before adding dated coding-task leaderboard snapshots with their sources. Done means the selected snapshots are recorded consistently and can support future model-choice discussions.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- machine-learning
- Domain
- documentation
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100