TEN-framework / TEN-framework/ten-framework
[FEATURE] Hope to add the SenseVoice Multilingual Voice Understanding Model
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 11.1k
- Forks
- 1.4k
- Avg merge
- 2d 15m
- Merged PRs (30d)
- 22
Description
Description
I hope to add the SenseVoice speech recognition model. The various TTS extensions on the TEN framework are too mechanical and lack emotion. SenseVoice performs better in this regard. It is recommended to add it.
Severity
Critical
Additional Information
https://github.com/FunAudioLLM/SenseVoice
SenseVoice is a speech foundation model with multiple speech understanding capabilities, including automatic speech recognition (ASR), spoken language identification (LID), speech emotion recognition (SER), and audio event detection (AED).
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the linked SenseVoice project and its ASR, LID, SER, and AED capabilities. Then inspect how TEN framework’s existing TTS extensions are structured and determine the integration scope; done should mean SenseVoice is supported without losing the capabilities described in the issue.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- machine-learning, python
- Domain
- ai, audio-video-rtc
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100