NVIDIA-ISAAC-ROS / NVIDIA-ISAAC-ROS/isaac_ros_pose_estimation

Need help on testing hardware

Open
#40 5 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C++
Stars
501
Forks
57
PR merge metrics
No merged PRs in 30d

Description

We have been able to run Python version of Foundationpose released by NVLabs on an RTX3060 With 12GB Ram whereas when we try ROS version of foundationpose the GPU memory requirements suits up and ultimately the execution stops with below errors:

component_container_mt-1] 2024-06-21 14:47:16.877 ERROR gxf/std/block_memory_pool.cpp@77: Failure in cudaMalloc. cuda_error: cudaErrorMemoryAllocation, error_str: out of memory
[component_container_mt-1] 2024-06-21 14:47:16.877 ERROR gxf/std/entity_warden.cpp@437: Failed to initialize component 00157 (pool)
[component_container_mt-1] 2024-06-21 14:47:16.877 ERROR gxf/core/runtime.cpp@702: Could not initialize entity 'YNWEMQPEYV_inference' (E152): GXF_OUT_OF_MEMORY
[component_container_mt-1] 2024-06-21 14:47:16.877 ERROR gxf/std/program.cpp@283: Failed to activate entity 00152 named YNWEMQPEYV_inference: GXF_OUT_OF_MEMORY
[component_container_mt-1] 2024-06-21 14:47:16.877 ERROR gxf/std/program.cpp@285: Deactivating...
[component_container_mt-1] 2024-06-21 14:47:16.877 ERROR gxf/core/runtime.cpp@1452: Graph activation failed with error: GXF_OUT_OF_MEMORY

Is there a fix/workaround of this? Is there any reason for memory requirement of this package to go higher compare to original Foundationpose?

The requirement mentioned by you on the documentation is already satisfied. https://nvidia-isaac-ros.github.io/repositories_and_packages/isaac_ros_pose_estimation/index.html#supported-platforms

image

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the ROS version of FoundationPose on an RTX3060 with 12GB RAM and compare it with the Python version from NVLabs. Use the reported cudaErrorMemoryAllocation and GXF_OUT_OF_MEMORY messages, along with the supported-platforms documentation, to determine the cause and document a verified workaround or fix.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, python
Domain
machine-learning, robotics
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.