NVIDIA-NeMo / NVIDIA-NeMo/RL

SFT OpenMathInstruct2 Example Fails Due to Incompatible Data Config

Open
#1,547 1 comment 0 reactions 0 assignees View on GitHub
bug i-tme
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

**Describe the bug**
Getting this error running the SFT example [here](https://docs.nvidia.com/nemo/rl/latest/guides/sft-openmathinstruct2.html#train-the-model) after logging into HF and WandB. The data configuration in /home/ameliay/RL/examples/configs/sft_openmathinstruct2.yaml is not compatible with run_sft.py. Fixed by setting num_worker=0.

Image

**Steps/Code to reproduce bug**

run `uv run examples/run_sft.py --config=examples/configs/sft_openmathinstruct2.yaml` and then log into WandB

**Expected behavior**

The file should run smoothly without any error

**Additional context**

Add any other context about the problem here.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.