Fine Tuning trust_remote_code=True

wandb disabled
torchrun --nproc_per_node=4 --master_port=20001 train.py
--model_name_or_path mosaicml/mpt-7b-chat
--data_path FastChat/data/dummy_conversation.json
--fp16 True
--output_dir output_mpt
--num_train_epochs 3
--per_device_train_batch_size 2
--per_device_eval_batch_size 2
--gradient_accumulation_steps 1
--evaluation_strategy "steps"
--eval_steps 2
--save_strategy "steps"
--save_steps 1200
--learning_rate 2e-5
--weight_decay 0.
--warmup_ratio 0.03
--lr_scheduler_type "cosine"
--logging_steps 1
--tf32 False
--model_max_length 2048
--gradient_checkpointing True
--lazy_preprocess True

ValueError: Loading mosaicml/mpt-7b-chat requires you to execute the configuration file in that repo on your local machine. Make sure you have
read the code there to avoid malicious use, then set the option trust_remote_code=True to remove this error.
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 1226441) of binary:

How can I fix it?
@merrymercy

Start with train.py and the model-loading path used by the shown torchrun command. Trace how mosaicml/mpt-7b-chat is loaded and where remote-code options are passed. Done means the reported ValueError is addressed and the fine-tuning command can proceed; verify with the provided command and dummy conversation dataset.