Expand Verifier Type to Add Support for Multiple Heuristics
- Dominant language
- Python
- Stars
- 2k
- Forks
- 561
- Avg merge
- 4d 5h
- Merged PRs (30d)
- 145
Description
**Is your feature request related to a problem? Please describe.**
Currently, every verifier type has a single implementation. For example, `math` verifier doesn't offer flexibility on how strict we would want the reward function to be regarding the formatting of the output.
Instead, it would be great if the strictness of the verifier could be configurable.
**Describe the solution you'd like**
[This notebook](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3_(1B)-GRPO.ipynb) from unsloth shows an example of how a simple implement for this could look like:
**Additional context**
Add any other context or screenshots about the feature request here
Contributor guide
Assessment
This issue has not been assessed yet.