Where does no_speech_threshold parameter is being set for whisper in tensorrt llm
Open
Nobody has claimed this yet.
Doc
feature request
Model customization
- Dominant language
- Python
- Stars
- 14.7k
- Forks
- 2.8k
- Avg merge
- 2d 23h
- Merged PRs (30d)
- 489
Description
System Info
1.Oracle A10 gpu
Who can help?
No response
Information
- The official example scripts
- My own modified scripts
Tasks
- An officially supported task in the
examplesfolder (such as GLUE/SQuAD, ...) - My own task or dataset (give details below)
Reproduction
Whisper decoding using cpp
Expected behavior
no_speech_threshold parameter for whisper decoding
actual behavior
There isnt any parameter like no_speech_threshold
additional notes
Cant find anywhere in modelrunnercpp args
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by inspecting the C++ model runner arguments used for Whisper decoding, since the report says no_speech_threshold is missing there. Compare the available decoding options with the expected Whisper parameter and determine whether the parameter is supported or needs exposure. Done means its configuration path and supported behavior are documented or implemented and verified with Whisper decoding.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- ai
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100