NVIDIA-ISAAC-ROS / NVIDIA-ISAAC-ROS/isaac_ros_object_detection

Inference not proper when deploying with this pipeline

Open
#18 8 comments 0 reactions 1 assignee View on GitHub

Nobody has claimed this yet.

bug
Dominant language
C++
Stars
201
Forks
51
PR merge metrics
No merged PRs in 30d

Description

Hello,

I have trained the detectnetV2 model on custom dataset using TAO toolkit. However, when I deploy the model with Isaac ROS Gems pipeline, the output inference is not reflecting the output metrics and the inference that I am seeing while using the TAO pipeline.

Later, I deployed the same model with deepstream and noticed that inference was as per the output metrics which I noticed while training the model.

I tried matching the hyper-parameters in the params.yaml file to match the config file of deepstream which I had used but there was no significant improvement in output inference. I am attaching the output images for i) TAO inference ii) Isaac ROS Gems inference iii) Deepstream inference for reference

Model was trained on 6000 images with 500 epochs which gave average precision(mAP) of ~95%. The config file used for training is same provided with DetectnetV2 for TAO training, no changes were done.

Isaac ROS Gems:
Screenshot from 2022-12-01 18-37-25

TAO inference:
rgb_80

Deep-stream:
Screenshot from 2022-12-27 17-41-04

Thanks,
Mayank

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.