ASSERT-KTH / ASSERT-KTH/repairbench-framework

reference performance of AI models on coding tasks

Open
#278 7 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
22
Forks
10
PR merge metrics
No merged PRs in 30d

Description

we copy-paste notable coding leaderboard snapshots, with source

this will be useful to argue for the choice of models in our future papers.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no file, test, or entry point. First locate where benchmark or model references are maintained, then review the existing format before adding dated coding-task leaderboard snapshots with their sources. Done means the selected snapshots are recorded consistently and can support future model-choice discussions.

Written by the indexing model from the issue text.

Assessment

Tech stack
machine-learning
Domain
documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.