pytorch / pytorch/TensorRT

🐛 [Bug] L1 resource partitioner test error on DLFW

Open
#4,040 0 comments 0 reactions 1 assignee View on GitHub

@cehongwang is already working on this.

Since Jan 26, 2026.

bug story: CI/CD & Testing Infrastructure
Dominant language
Python
Stars
3k
Forks
410
Avg merge
3d 18h
Merged PRs (30d)
78

Description

Bug Description

L1 resource partitioner test error: on dlfw gb200nvl, h100, a100 etc:

FAILED test_001_resource_partitioning.py::TestResourcePartitioning::test_resource_partitioning - ValueError: CPU memory budget is too small to compile the model. used_rss: 2387 MB, subgraph_size_budget: -85 MB, CPU memory budget: -340 MB, Model size: 410 MB. Consider setting cpu_memory_budget to a larger value.
FAILED test_001_resource_partitioning.py::TestResourcePartitioning::test_resource_partitioning_with_capability_partitioning - ValueError: CPU memory budget is too small to compile the model. used_rss: 3548 MB, subgraph_size_budget: -529.0 MB, CPU memory budget: -2116.0 MB, Model size: 720 MB. Consider setting cpu_memory_budget to a larger value.
FAILED test_001_resource_partitioning.py::TestResourcePartitioning::test_resource_partitioning_with_capability_partitioning_and_atomic_subgraphs - ValueError: CPU memory budget is too small to compile the model. used_rss: 5086 MB, subgraph_size_budget: -914.0 MB, CPU memory budget: -3654.0 MB, Model size: 720 MB. Consider setting cpu_memory_budget to a larger value.
FAILED test_001_resource_partitioning.py::TestResourcePartitioning::test_resource_partitioning_with_global_capability_partitioning - ValueError: CPU memory budget is too small to compile the model. used_rss: 5086 MB, subgraph_size_budget: -914.0 MB, CPU memory budget: -3654.0 MB, Model size: 122 MB. Consider setting cpu_memory_budget to a larger value.

To Reproduce

you can use dlfw image to reproduce:
gitlab-master.nvidia.com/dl/dgx/pytorch:torchtrt_26.02-py3.42406598-devel-arm64 bash

Expected behavior

Environment

Build information about Torch-TensorRT can be found by turning on debug messages

  • Torch-TensorRT Version (e.g. 1.0.0):
  • PyTorch Version (e.g. 1.0):
  • CPU Architecture:
  • OS (e.g., Linux):
  • How you installed PyTorch (conda, pip, libtorch, source):
  • Build command you used (if compiling from source):
  • Are you using local sources or building from archives:
  • Python version:
  • CUDA version:
  • GPU models and configuration:
  • Any other relevant information:

Additional context

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.