lm-sys / lm-sys/FastChat

mistral 7b train

Open
#2,861 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
39.5k
Forks
4.8k
PR merge metrics
No merged PRs in 30d

Description

Nice work.
I am trying to use fastchat to train a mistral model. however, I wonder why the following code is hard code for only vicuna.
https://github.com/lm-sys/FastChat/blob/main/fastchat/train/train.py

conv = get_conversation_template("vicuna")
and
assert conv.sep_style == SeparatorStyle.ADD_COLON_TWO

Did I misunderstand something?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with fastchat/train/train.py and inspect the conversation-template selection and SeparatorStyle assertion shown in the issue. Determine whether these assumptions prevent Mistral training and clarify what behavior or support is expected before defining completion criteria.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.