NVIDIA-NeMo / NVIDIA-NeMo/RL

Default chat template in SFT training

Open
#1,003 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

It would be better to use the model's original chat template as default [here](https://github.com/NVIDIA-NeMo/RL/blob/d168de3f95e87c7d9e9c38237874b390c017a76f/examples/configs/sft.yaml#L28), or at least tell people how to do so.
`chat_template="default"`

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.