NVIDIA-NeMo / NVIDIA-NeMo/RL

refactor eval dataset to reuse train response dataset

Open
#2,840 0 comments 0 reactions 1 assignee Claimed by @yuki-97 View on GitHub
Feature
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

Eval datasets and response/train datasets in NeMo-RL frequently wrap the same underlying HuggingFace datasets, duplicating loader logic, dataset IDs, input-key conventions, and per-variant branching.

It's better to unify them to use a same one, so that we don't need to support them twice.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.