NVIDIA-NeMo / NVIDIA-NeMo/RL

Set timeout and RAM limit inside code environment

Open
#816 0 comments 0 reactions 0 assignees View on GitHub
external x-google
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

**Is your feature request related to a problem? Please describe.**

For training or evaluating coding problems, we need to set a timeout and RAM limit for the program. Otherwise, the model may only learn brute force approaches.

**Describe the solution you'd like**

We may add timeout and ram limit as part of the input metadata and CodeEnvironment can retrieve those information from metadata and throws exceptions if the code violates those constraints.

**Describe alternatives you've considered**

N/A

**Additional context**

Add any other context or screenshots about the feature request here

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.