🐛 [Bug] Python only pipeline failed on weight streaming test
Open
Nobody has claimed this yet.
bug
- Dominant language
- Python
- Stars
- 3k
- Forks
- 410
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 78
Description
Bug Description
FAILED test_004_weight_streaming.py::TestWeightStreamingPython::test_weight_streaming_default - assert 245760 == 122880
To execute this test, run the following from the base repo dir:
python test_004_weight_streaming.py TestWeightStreamingPython.test_weight_streaming_default
This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
FAILED test_004_weight_streaming.py::TestWeightStreamingPython::test_weight_streaming_manual - assert 245760 == 172032
+ where 245760 = <torch_tensorrt.runtime._weight_streaming._WeightStreamingContextManager object at 0x7f222d9dada0>.device_budget
To execute this test, run the following from the base repo dir:
python test_004_weight_streaming.py TestWeightStreamingPython.test_weight_streaming_manual
This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
FAILED test_004_weight_streaming.py::TestWeightStreamingPython::test_weight_streaming_multi_rt - assert 229216 <= 1
+ where 229216 = abs((241280 - 12064))
+ where 241280 = <torch_tensorrt.runtime._weight_streaming._WeightStreamingContextManager object at 0x7f23951782e0>.device_budget
To execute this test, run the following from the base repo dir:
python test_004_weight_streaming.py TestWeightStreamingPython.test_weight_streaming_multi_rt
This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
```====== 3 failed, 68 passed, 70 skipped, 193 warnings in 65.68s (0:01:05) =======
https://github.com/pytorch/TensorRT/actions/runs/27276832526/job/80564013889
## To Reproduce
Steps to reproduce the behavior:
1.
2.
3.
<!-- If you have a code sample, error messages, stack traces, please provide it here as well -->
## Expected behavior
<!-- A clear and concise description of what you expected to happen. -->
## Environment
> Build information about Torch-TensorRT can be found by turning on debug messages
- Torch-TensorRT Version (e.g. 1.0.0):
- PyTorch Version (e.g. 1.0):
- CPU Architecture:
- OS (e.g., Linux):
- How you installed PyTorch (`conda`, `pip`, `libtorch`, source):
- Build command you used (if compiling from source):
- Are you using local sources or building from archives:
- Python version:
- CUDA version:
- GPU models and configuration:
- Any other relevant information:
## Additional context
<!-- Add any other context about the problem here. -->
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with test_004_weight_streaming.py and run the three reported tests: test_weight_streaming_default, test_weight_streaming_manual, and test_weight_streaming_multi_rt. Trace the weight-streaming runtime behavior behind the device_budget assertions and verify that all three tests pass without changing the expected test coverage.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning, testing-qa
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 55/100