enforce_eager=True not being respected in test scripts
@bradhilton is already working on this.
Since Jul 21, 2025.
- Dominant language
- Python
- Stars
- 10.8k
- Forks
- 989
- Avg merge
- 6h 29m
- Merged PRs (30d)
- 85
Description
Problem
When running test scripts with enforce_eager=True specified, the logs still show enforce_eager=False and CUDA graphs are being calculated. This makes startup slower and leads to a slower feedback cycle during testing.
Reproduction
In the test script src/art/test/test_step_skipping.py, we're passing enforce_eager=True:
# Register the model
await model.register(
backend,
_openai_client_config={"engine_args": {"enforce_eager": True}},
)
However, when running the script, the logs show that enforce_eager is still False and CUDA graphs are being compiled.
Expected Behavior
When enforce_eager=True is passed in the configuration, it should:
- Skip CUDA graph compilation
- Start up faster
- Provide quicker feedback during testing
Impact
This issue affects development velocity as tests take longer to start and provide feedback than necessary.
Environment
- The issue can be reproduced by running:
./src/art/test/test_step_skipping.py - The script is configured to run on GPU with sky launch
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.