NVIDIA-NeMo / NVIDIA-NeMo/Guardrails
feature: GenerationLog support in Colang 2.x
Open
@Pouyanpi is already working on this.
Since Oct 5, 2024.
enhancement
- Dominant language
- Python
- Stars
- 7.2k
- Forks
- 842
- Avg merge
- 3d 1h
- Merged PRs (30d)
- 25
Description
Did you check the docs?
- I have read all the NeMo-Guardrails docs
Is your feature request related to a problem? Please describe.
Currently Colang 2 does not support some of the nice features of Colang 1.0, specifically it has limited support for GenerationOptions like GenerationLog. This feature is crucial for better observability into various compontnets of a rails instance.
Describe the solution you'd like
Enable GenerationLog in Colang 2.x, it requires implementation of compute_generation_log method similar to its Colang 1.0 counterpart and popoulate the GenerationLog object.
Describe alternatives you've considered
For compatibility the feature needs to be implemented, no alternative available.
Additional context
- add the exact path to implementation here.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.