NVIDIA-NeMo / NVIDIA-NeMo/RL

Expand Verifier Type to Add Support for Multiple Heuristics

Open
#940 0 comments 0 reactions 0 assignees View on GitHub
algorithm external x-google
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

**Is your feature request related to a problem? Please describe.**

Currently, every verifier type has a single implementation. For example, `math` verifier doesn't offer flexibility on how strict we would want the reward function to be regarding the formatting of the output.

Instead, it would be great if the strictness of the verifier could be configurable.

**Describe the solution you'd like**

[This notebook](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3_(1B)-GRPO.ipynb) from unsloth shows an example of how a simple implement for this could look like:

Image

**Additional context**

Add any other context or screenshots about the feature request here

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.