lm-sys / lm-sys/FastChat

how to commit a new model(maybe custom .etc) to arena leadboard?

Open
#3,692 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
39.5k
Forks
4.8k
PR merge metrics
No merged PRs in 30d

Description

Hi,I come from a LLM Lab.I am looking forward to the competitive level of our models on the list, I want to know everything about submitting models to the Arena Leaderboard. Please let me know If there are any guiding submission instructions.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names the Arena Leaderboard but provides no file, test, or entry point. Start by locating the leaderboard submission workflow and any existing model-submission documentation in the repository; done means a newcomer can follow documented steps to submit a custom model.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.