OpenMOSS / OpenMOSS/MOSS

--deepspeed_multinode_launcher: 未找到命令

Open
#147 6 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
12.3k
Forks
1.1k
PR merge metrics
No merged PRs in 30d

Description

按照官方教程进行训练,启动训练脚本时提示--deepspeed_multinode_launcher: 未找到命令
以下时启动脚本配置:
num_machines=4
num_processes=$((num_machines * 8))
machine_rank=0

accelerate launch
--config_file ./configs/sft.yaml
--num_processes $num_processes
--num_machines $num_machines
--machine_rank $machine_rank \
--deepspeed_multinode_launcher standard finetune_moss.py
--model_name_or_path /root/liuliu/moss/moss-moon-003-sft-plugin
--data_dir ./sft_data
--output_dir ./ckpts/moss-moon-003-sft
--log_dir ./train_logs/moss-moon-003-sft
--n_epochs 2
--train_bsz_per_gpu 4
--eval_bsz_per_gpu 4
--learning_rate 0.000015
--eval_step 10
--save_step 10

这样的问题应该怎么解决,已经使用pip 安装了deepspeed

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the shown accelerate launch command, configs/sft.yaml, and finetune_moss.py, then reproduce the --deepspeed_multinode_launcher error in the documented four-machine setup. Compare the installed accelerate and deepspeed command-line options with the official tutorial; done means the launcher argument is accepted and the training script starts across the configured machines.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
distributed-systems, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.