Owner

OptimalScale

1 indexed repository · View on GitHub

LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Python · 8487 stars

Beginner friendly Everything

Open All

"trust_remote_code=True" problem Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

OptimalScale/LMFlow#754 · 1 comment · Opened Apr 10, 2024
[DPO is available?] Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

OptimalScale/LMFlow#741 · 2 comments · Opened Apr 3, 2024
is support llava model ? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

OptimalScale/LMFlow#730 · 3 comments · Opened Apr 1, 2024
[BUG] LISA: same loss regardless of lisa_activated_layers Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

OptimalScale/LMFlow#726 · 17 comments · Opened Mar 31, 2024
[BUG] deepspeed.runtime.zero.utils.ZeRORuntimeException: You are using ZeRO-Offload with a client provided optimizer Open

pending

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OptimalScale/LMFlow#693 · 2 comments · Opened Jan 18, 2024
[BUG]Output my input Open

pending

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OptimalScale/LMFlow#692 · 4 comments · Opened Jan 15, 2024
Perform Inference using Python instead of command line Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

OptimalScale/LMFlow#691 · 1 comment · Opened Jan 4, 2024
Use Ollama to perform inference with trained model using LMFLOW Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

OptimalScale/LMFlow#689 · 1 comment · Opened Dec 20, 2023
Minimum Requirement of GPU for Fine Tuning Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OptimalScale/LMFlow#687 · 4 comments · Opened Dec 14, 2023
No checkpoints saved with full finetune even when I set --save_steps Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

OptimalScale/LMFlow#683 · 1 comment · Opened Dec 6, 2023
Experiments for speculative_decoding Open

Difficulty 2/5 1-3 hours Newbie friendliness 25/100

OptimalScale/LMFlow#680 · 3 comments · Opened Nov 20, 2023
baichuan-inc_Baichuan2-7B-Chat can't training Open

pending

Difficulty 3/5 1-2 days Newbie friendliness 25/100

OptimalScale/LMFlow#678 · 2 comments · Opened Nov 13, 2023
LoRA + FlashAttention2 speed up？ Open

Difficulty 4/5 3-5 days Newbie friendliness 15/100

OptimalScale/LMFlow#677 · 1 comment · Opened Nov 11, 2023
How to fix the git clone Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

OptimalScale/LMFlow#676 · 1 comment · Opened Nov 11, 2023
[Request For New Feature] Support InternLM Model Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

OptimalScale/LMFlow#671 · 1 comment · Opened Nov 6, 2023
[BUG]Model size change Open

pending

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OptimalScale/LMFlow#662 · 5 comments · Opened Oct 20, 2023
lora training - Input：Instruction Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

OptimalScale/LMFlow#661 · 1 comment · Opened Oct 19, 2023
Issues of local deployment Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OptimalScale/LMFlow#660 · 3 comments · Opened Oct 18, 2023
Issue on default temperature settings Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

OptimalScale/LMFlow#659 · 1 comment · Opened Oct 17, 2023
Support Mistral 7B model Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

OptimalScale/LMFlow#652 · 3 comments · Opened Sep 29, 2023
what's the difference between text_only and text2text data type? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OptimalScale/LMFlow#645 · 8 comments · Opened Sep 13, 2023
[New Feature][Roadmap requested]Do you have a roadmap right now? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

OptimalScale/LMFlow#605 · 2 comments · Opened Aug 8, 2023
Issue with Recreating RAFT Llama-7b Lora Benchmarks Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OptimalScale/LMFlow#535 · 13 comments · Opened Jun 29, 2023
[BUG]not support baichuan-7b Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OptimalScale/LMFlow#520 · 5 comments · Opened Jun 25, 2023
Size mismatch for base_model.model.transformer for bloomz model finetuning Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

OptimalScale/LMFlow#517 · 3 comments · 1 reaction · Opened Jun 25, 2023
`preprocessing_num_workers` can not use in `scripts/run_finetune.sh` Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

OptimalScale/LMFlow#482 · 6 comments · Opened Jun 9, 2023
Load finetune model fails Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

OptimalScale/LMFlow#307 · 12 comments · Opened Apr 25, 2023
[ERROR] [launch.py:324:sigkill_handler] exits with return code = -9 Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

OptimalScale/LMFlow#179 · 20 comments · Opened Apr 9, 2023
Finetuning Chinese models Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

OptimalScale/LMFlow#62 · 9 comments · Opened Apr 3, 2023

OptimalScale

Get new issues in your inbox