NVIDIA-NeMo / NVIDIA-NeMo/Guardrails
[Bug] Rail Configuration Validation Missing - Invalid Rules Not Caught
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 7.2k
- Forks
- 843
- Avg merge
- 3d 1h
- Merged PRs (30d)
- 25
Description
Description
Rail config files aren't validated. Invalid rules accepted. Runtime errors occur during inference.
Expected Behavior
Validate config schema at load time.
Actual Behavior
File: src/config/loader.py
No validation: load_config(config_file)
GSSoC Points Estimate: Level 1 (Bug)
Suggested Labels
- gssoc:approved
- type:bug
- severity:medium
- area:validation
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start in src/config/loader.py at load_config(config_file) and trace how configuration files are loaded. Determine the expected config schema and add load-time validation so invalid rules are rejected before inference; done means malformed rules no longer reach runtime inference.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 58/100