An error occurred while converting Llama3.2-1B-Instruct to Megatron ckpt.

I need to train the Llama 3.2-1B-Instruct model, but there is no configuration file for it in slime/scripts/models, which prevents me from converting it into a Megatron checkpoint. I have added a custom configuration file llama3.2-1B-Instruct.sh with the following parameters:

MODEL_ARGS=(
   --swiglu
   --num-layers 16
   --hidden-size 2048
   --ffn-hidden-size 8192
   --num-attention-heads 32
   --group-query-attention
   --num-query-groups 8
   --max-position-embeddings 131072
   --use-rotary-position-embeddings
   --disable-bias-linear
   --normalization "RMSNorm"
   --norm-epsilon 1e-5
   --rotary-base 500000
   --vocab-size 128256
   --kv-channels 64
   --use-rope-scaling
   --rotary-scaling-factor 32.0
)

However, during the training process, the sample.response is garbled. I suspect that there was an error during the conversion to the Megatron checkpoint. How can I resolve this issue?

Start by reviewing the custom configuration in slime/scripts/models and the conversion process that produces the Megatron checkpoint. Reproduce the training case with Llama 3.2-1B-Instruct, verify whether the checkpoint conversion is valid, and confirm that sample.response is no longer garbled.