NVIDIA / NVIDIA/TensorRT-Edge-LLM
Some tips when you use trtexec to build and infer
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 563
- Forks
- 135
- Avg merge
- 14h 13m
- Merged PRs (30d)
- 1
Description
About llm, trtexec also can build and infer, but has some pitfalls.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names trtexec and LLM build and inference but does not mention any file, test, or entry point. Start by locating existing trtexec-related documentation and examples; done should clearly document the relevant pitfalls and usage guidance.
Written by the indexing model from the issue text.
Assessment
- Domain
- cli, documentation
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100