lm-sys/FastChat

View on GitHub

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Stars: 39.5k
Forks: 4.8k
Open beginner issues: 2
Indexed issues: 899

Dominant language: Python
License: Apache-2.0
Last GitHub push: Jun 2, 2025
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue help wanted
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

899 open issues indexed

worker_name 和 worker_address混淆了吗 Open

Difficulty 2/5 1-3 hours Newbie friendliness 48/100

lm-sys/FastChat#3694 · Opened Mar 13, 2025
how to commit a new model(maybe custom .etc) to arena leadboard? Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

lm-sys/FastChat#3692 · Opened Mar 3, 2025
由于项目长时间不间断运行，导致调接口出现错误"Broken pipe" Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3689 · Opened Feb 25, 2025
Upload textual files to the Arena Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

lm-sys/FastChat#3686 · 2 comments · Opened Feb 23, 2025
Why gpt-4o-2024-11-20 not on the latest leaderboard. Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

lm-sys/FastChat#3685 · 1 comment · 1 reaction · Opened Feb 22, 2025
How to Modify Code to Run MT-Bench with 'ThaiLLM-Leaderboard/mt-bench-thai' Dataset? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3684 · Opened Feb 20, 2025
Benchmark Gaming Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

lm-sys/FastChat#3682 · Opened Feb 18, 2025
Filter to hide proprietary licensed model Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

lm-sys/FastChat#3680 · Opened Feb 15, 2025
Are there plans to support DeepSeek-R1-Distill-Qwen models? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lm-sys/FastChat#3677 · 1 comment · 3 reactions · Opened Feb 11, 2025
Delayed Response Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lm-sys/FastChat#3676 · Opened Feb 11, 2025
"ERROR" on LMSYS arena Open

Difficulty 4/5 3-5 days Newbie friendliness 15/100

lm-sys/FastChat#3675 · Opened Feb 9, 2025
Ah yes, *blank issue* Open

Difficulty 5/5 Over a week Newbie friendliness 1/100

lm-sys/FastChat#3674 · Opened Feb 9, 2025
Add GitLab to RepoChat Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3672 · Opened Jan 27, 2025
Documentation of system prompts? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3670 · 2 comments · 1 reaction · Opened Jan 25, 2025
Gradio 5 is out, and there are many improvements. Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lm-sys/FastChat#3669 · Opened Jan 24, 2025
nexpected Wobble Effect in 🏆 Chatbot Arena LLM Leaderboard Section (Possible UI Bug) Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

lm-sys/FastChat#3667 · Opened Jan 24, 2025
Ux suggestion: disable auto scroll Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

lm-sys/FastChat#3662 · Opened Jan 14, 2025
NETWORK ERROR DUE TO HIGH TRAFFIC. PLEASE REGENERATE OR REFRESH THIS PAGE. Open

Difficulty 4/5 3-5 days Newbie friendliness 15/100

lm-sys/FastChat#3659 · Opened Jan 10, 2025
Can the fastchat framework deploy the InternVL2_5-78B model？ Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lm-sys/FastChat#3656 · Opened Jan 9, 2025
Sign in error: "Too many requests. Please try again later." Confusing issue, no clear requirements. Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lm-sys/FastChat#3651 · Opened Jan 6, 2025
Using vllm model as a judge Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

lm-sys/FastChat#3650 · Opened Jan 4, 2025
Tor Browser: Frequent "Connection errored out" / "Something went wrong" Errors Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3649 · 4 comments · Opened Jan 2, 2025
deepspeed problem with train_lora.py Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3648 · Opened Dec 30, 2024
I cannot upload this image for the models to feedback. Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

lm-sys/FastChat#3647 · Opened Dec 28, 2024
max-model-len 设置为固定的数值，生成了大量重复的内容 Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

lm-sys/FastChat#3644 · Opened Dec 19, 2024
How to specify the --conv-template to appropriately launch the aya-32b model via fastchat Open

Difficulty 3/5 1-2 days Newbie friendliness 20/100

lm-sys/FastChat#3643 · Opened Dec 16, 2024
support bge-reranker-v2-m3? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lm-sys/FastChat#3640 · Opened Dec 10, 2024
Direct link to Leaderboard Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

lm-sys/FastChat#3634 · 3 comments · Opened Nov 28, 2024
Version compatibility problem Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

lm-sys/FastChat#3631 · 4 comments · 2 reactions · Opened Nov 26, 2024
Obnoxious "Connection Errored Out"s Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3630 · Opened Nov 23, 2024
garbled text generation on Mac Open

Difficulty 4/5 3-5 days Newbie friendliness 28/100

lm-sys/FastChat#3629 · 2 comments · Opened Nov 21, 2024
Connect call failed ('127.0.0.1', 21002) Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

lm-sys/FastChat#3626 · Opened Nov 20, 2024
Claude 3.5 Haiku, Mistral Large 24.11 and Pixtral 124-B Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

lm-sys/FastChat#3623 · Opened Nov 19, 2024
Gemini Exp 1114 cutoff date Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

lm-sys/FastChat#3622 · Opened Nov 18, 2024
Sharing new model Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

lm-sys/FastChat#3621 · Opened Nov 17, 2024
Dataset: timestamp Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

lm-sys/FastChat#3617 · Opened Nov 14, 2024
What is the version of gradio? Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

lm-sys/FastChat#3616 · Opened Nov 14, 2024
Feature request: only show open-source models Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

lm-sys/FastChat#3614 · Opened Nov 13, 2024
Improve website display about latex character Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

lm-sys/FastChat#3613 · Opened Nov 12, 2024
Add Grok Beta and Claude 3.5 Haiku on lmarena.ai Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

lm-sys/FastChat#3610 · 1 comment · Opened Nov 6, 2024
Same model comparison in ArenaHub (HUggingFace fork) lead to 3 model comparison Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3607 · Opened Nov 1, 2024
Custom Leaderboard Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lm-sys/FastChat#3605 · 1 reaction · Opened Oct 30, 2024
APIError: Invalid response object from API: 'Internal Server Error' (HTTP response code was 500) Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

lm-sys/FastChat#3603 · Opened Oct 28, 2024
Yi Lightning model is unstable and might has network errors on lmarena.ai in some prompts Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3602 · 4 comments · Opened Oct 28, 2024
Not all leaderboard elements cope good with various with of browser display area Open

Difficulty 3/5 1-2 days Newbie friendliness 30/100

lm-sys/FastChat#3601 · Opened Oct 27, 2024
AttributeError in Gradio Web Server: 'list' object has no attribute 'text_models' Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

lm-sys/FastChat#3595 · 2 comments · Opened Oct 22, 2024
How to find voting result and create plot? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3594 · Opened Oct 22, 2024
زندگی رویایی Open

Difficulty 5/5 Over a week Newbie friendliness 1/100

lm-sys/FastChat#3593 · 1 comment · Opened Oct 20, 2024
Inquiry Regarding Your Paper "Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena" Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lm-sys/FastChat#3590 · 1 reaction · Opened Oct 16, 2024
Stop button on web interface Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lm-sys/FastChat#3583 · Opened Oct 11, 2024

lm-sys/FastChat

Get new issues in your inbox