Can I run two context at the same time
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 13.4k
- Forks
- 2.4k
- Avg merge
- 5d 3h
- Merged PRs (30d)
- 2
Description
I create two contexts from the same engine, and want to perform inference simultaneously, but from the nsys file, these two context didn't run at the same time. Want to know why and what is the difference between this situation and the example provided from https://developer.download.nvidia.com/CUDA/training/StreamsAndConcurrencyWebinar.pdf
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue mentions two contexts created from one engine, an Nsight Systems (nsys) capture, and the Streams and Concurrency webinar, but names no repository files or tests. Start by reviewing the capture alongside the webinar's concurrency assumptions and the TensorRT context and stream documentation. Done means explaining why the contexts do not overlap and identifying the conditions needed for simultaneous inference.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- machine-learning, performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100