ProjectTech4DevAI / ProjectTech4DevAI/kaapi-backend
Recommend automated metric for TTS evals
Open
@rajagopalmotivate is already working on this.
Since Feb 17, 2026.
research
- Dominant language
- Python
- Stars
- 18
- Forks
- 10
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 14
Description
- We are going live with Human annotation as part of Subjective evals
- But along with that we need to have another 1-2 metrics that will get auto computed
- Basis few sample check from Raj's data, we could see Semantic similarity (Via LLM) was making sense besides WER
- But we need to finalise it after checking more data across languages.
ref: https://discord.com/channels/1014768296257654865/1463434906712670446/1471472813411012723
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.