lm-sys/FastChat

View on GitHub

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Stars: 39.5k
Forks: 4.8k
Open beginner issues: 2
Indexed issues: 899

Dominant language: Python
License: Apache-2.0
Last GitHub push: Jun 2, 2025
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue help wanted
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

899 open issues indexed

chatglm3-6b-32k generate abnormal output like <|user|> and <|assistant|> Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3421 · Opened Jun 26, 2024
[Chatbot Arena] Add GLM-4 variants: AirX, Air and Flash Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

lm-sys/FastChat#3420 · 5 reactions · Opened Jun 25, 2024
SHARE NOT WORKING Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

lm-sys/FastChat#3417 · Opened Jun 23, 2024
Can GPTCache be used in FastChat? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

lm-sys/FastChat#3416 · Opened Jun 23, 2024
Add GPT-J 6B Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

lm-sys/FastChat#3412 · Opened Jun 20, 2024
glm4 Churn out Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3411 · 4 comments · 1 reaction · Opened Jun 20, 2024
ascend NPU how to Multiple NPUs Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lm-sys/FastChat#3410 · 1 comment · Opened Jun 19, 2024
unable to communicate with mistral models deployed in EC2 by using gradio_webserver API Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3409 · Opened Jun 19, 2024
how to serve Gradio app on the cloud and run inference locally Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lm-sys/FastChat#3408 · Opened Jun 17, 2024
[Feat Request] Adding 72b/110b llava to multimodal chatbot areana Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lm-sys/FastChat#3406 · 4 reactions · Opened Jun 15, 2024
LLM + knowledge Graph Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

lm-sys/FastChat#3403 · Opened Jun 12, 2024
Could not find the transformer layer class to wrap in the model. Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3400 · 2 comments · Opened Jun 12, 2024
prompt will always be truncated Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

lm-sys/FastChat#3399 · Opened Jun 12, 2024
Gradio web server requires model-worker deps Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3397 · Opened Jun 11, 2024
Fine-tuning Vicuna-7B Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

lm-sys/FastChat#3396 · Opened Jun 11, 2024
Implement GLM-4 models Open

Difficulty 4/5 3-5 days Newbie friendliness 28/100

lm-sys/FastChat#3395 · Opened Jun 11, 2024
Add AutoCoder LLM Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lm-sys/FastChat#3393 · Opened Jun 9, 2024
Add Character.AI's C1.0, C1.1, C1.2 Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lm-sys/FastChat#3392 · Opened Jun 9, 2024
Add xAI Grok-1 Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lm-sys/FastChat#3391 · Opened Jun 9, 2024
Semaphore release Issue in api_generate_stream Function of vllm_worker Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

lm-sys/FastChat#3389 · Opened Jun 9, 2024
Add support for the Korean language Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

lm-sys/FastChat#3387 · Opened Jun 8, 2024
The accuracy issue of MT bench Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3386 · Opened Jun 7, 2024
Where could I get the code for https://chat.lmsys.org/ Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lm-sys/FastChat#3384 · Opened Jun 7, 2024
当我试图集成chatglm2-6b的时候发现如下错误 Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

lm-sys/FastChat#3383 · 1 comment · Opened Jun 7, 2024
how to adapting GLM4 & QWEN2 to FastChat Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3382 · 2 comments · Opened Jun 7, 2024
FastChat Code base help Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3381 · 1 comment · Opened Jun 6, 2024
generate Vicuna error Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

lm-sys/FastChat#3380 · 1 comment · Opened Jun 6, 2024
how to submit with enter Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

lm-sys/FastChat#3379 · Opened Jun 5, 2024
How does calibrating for an anchor model in `elo_analysis` affect the elo ratings and bootstrap CIs? Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lm-sys/FastChat#3377 · Opened Jun 4, 2024
how to customize free-style LLM? Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lm-sys/FastChat#3374 · Opened Jun 2, 2024
Can Azure openai GPT-4 work as judge? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3371 · 1 comment · Opened May 30, 2024
Does it support Qwen1.5? Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lm-sys/FastChat#3369 · Opened May 29, 2024
gguf Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lm-sys/FastChat#3368 · Opened May 29, 2024
OpenAI API Streaming Issue Occurs with Error Code 50001 Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

lm-sys/FastChat#3367 · Opened May 29, 2024
fastchat.serve.model_worker --port 21003 and /v1/models show nothing Open

Difficulty 3/5 1-2 days Newbie friendliness 30/100

lm-sys/FastChat#3365 · Opened May 28, 2024
spring ai的集成 Open

Difficulty 5/5 Over a week Newbie friendliness 18/100

lm-sys/FastChat#3363 · 1 comment · Opened May 27, 2024
Feature: Add OpenAI Usage stats when using streaming with the Chat Completions API or Completions API Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lm-sys/FastChat#3360 · 11 comments · Opened May 23, 2024
Support for Phi-3 small and Phi-3 medium? Multimodal support? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

lm-sys/FastChat#3359 · 4 comments · 1 reaction · Opened May 22, 2024
[Bug] Single quote character `'` tripping up model generation and streaming Open

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

lm-sys/FastChat#3358 · Opened May 22, 2024
Unable to use streaming with the /v1/embeddings API for the CodeQwen1.5-7B model. Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lm-sys/FastChat#3357 · 1 comment · Opened May 22, 2024
Cannot use /v1/embeddings api with BGE-M3 model Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

lm-sys/FastChat#3355 · Opened May 22, 2024
New dataset release? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

lm-sys/FastChat#3353 · 1 reaction · Opened May 21, 2024
Cannot succesfully pull VLMs to fastchat Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lm-sys/FastChat#3348 · 5 comments · Opened May 20, 2024
Error: Type object 'Dropdown' has no attribute 'update' in "qa_browser.py" Open

Difficulty 2/5 1-3 hours Newbie friendliness 42/100

lm-sys/FastChat#3347 · 2 comments · Opened May 17, 2024
moderate cannot be deactivated when running api-based model Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

lm-sys/FastChat#3345 · 1 comment · Opened May 17, 2024
火针 Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

lm-sys/FastChat#3333 · 6 reactions · Opened May 14, 2024
Vllm worker does not release semaphore Open

Difficulty 4/5 3-5 days Newbie friendliness 28/100

lm-sys/FastChat#3328 · Opened May 13, 2024
Support stream_options for openAI API Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

lm-sys/FastChat#3324 · 1 comment · 1 reaction · Opened May 10, 2024
Inquiry Regarding the Release of 1k MT-Bench Dataset Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lm-sys/FastChat#3321 · Opened May 9, 2024
new release? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

lm-sys/FastChat#3317 · 3 comments · 4 reactions · Opened May 7, 2024

lm-sys/FastChat

Get new issues in your inbox