NVIDIA / NVIDIA/TensorRT

How many ways to speed up the time during Conveting onnx-->Tensorrt?

Open
#4,169 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Module:Engine Build triaged
Dominant language
C++
Stars
13.4k
Forks
2.4k
Avg merge
5d 3h
Merged PRs (30d)
2

Description

How many ways to speed up the time during Conveting onnx-->Tensorrt? While I convert an model Costing 10mins or more,Hope for some ways to reduce time.
I am Converting an Yolo8 instance model on platforms RTX 1650,and some else model will be used as well.
If mudually set tensorrt layers, be sooner? Or any other ways, Thanks for suggestions.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by examining the reported ONNX-to-TensorRT conversion of a YOLOv8 instance model on an RTX 1650 and identify what part of the conversion consumes the reported 10 minutes or more. Compare the suggested manual TensorRT layer configuration with other approaches, and consider the work complete only when a specific, reproducible way to reduce conversion time is established.

Written by the indexing model from the issue text.

Assessment

Domain
machine-learning, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.