anomalyco / anomalyco/models.dev
Request to add Aider benchmark results
Nobody has claimed this yet.
- Dominant language
- TypeScript
- Stars
- 6.9k
- Forks
- 1.7k
- Avg merge
- 3h 21m
- Merged PRs (30d)
- 873
Description
Hello,
I would like to suggest including Aider's benchmark results in the models.dev repository. Since Aider is a cli agentic tool to help people code, they made a nice benchmarking tool to measure performance on coding tasks using their tool. Usually I find the result interesting when comparing LLM models
Byee !
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating how models.dev stores model and benchmark data, then inspect the repository’s existing data entry points and validation checks. Compare the available Aider benchmark results with the data model and determine what can be represented. Done means the Aider results are added in the repository’s expected format and pass its relevant checks.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- typescript
- Domain
- ai, data
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100