[Usage]: the class member -- multimodalInput, multimodalEmbedding of request (at cpp/include/tensorrt_llm/executor/executor.h) seem unused in tensorrt-llm
Open
@chang-l is already working on this.
Since Nov 18, 2025.
Multimodal
question
- Dominant language
- Python
- Stars
- 14.7k
- Forks
- 2.8k
- Avg merge
- 2d 23h
- Merged PRs (30d)
- 489
Description
System Info
when I reading the soure code , I noticed that the class member -- multimodalInput, multimodalEmbedding of request (at cpp/include/tensorrt_llm/executor/executor.h) seem unused in tensorrt-llm. Could you clarify where these two parameters come into play.
How would you like to use TensorRT-LLM
I want to run inference of a [specific model](put Hugging Face link here). I don't know how to integrate it with TensorRT-LLM or optimize it for my use case.
Specific questions:
- Model:
- Use case (e.g., chatbot, batch inference, real-time serving):
- Expected throughput/latency requirements:
- Multi-GPU setup needed:
Before submitting a new issue...
- Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.