ProjectTech4DevAI / ProjectTech4DevAI/kaapi-backend
STS: Reducing high latency issues
Open
@Prajna1999 is already working on this.
Since Jul 10, 2026.
- Dominant language
- Python
- Stars
- 18
- Forks
- 10
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 14
Description
Is your feature request related to a problem?
We are experiencing high latency in STS flows, exceeding 40 seconds. This delays response times and impacts user experience.
Describe the solution you'd like
- Track and reduce kaapi side latency (make intermediate callbacks async for llm/chain)
- Explore ways to reduce latency at TTS
- Conduct testing on Glific end before further action
Original issue
- Track and reduce if any kaapi side latency (llm/chain: make intermediate callbacks async)
- Explore reduction on latency at TTS
Comments: - STS with FS is done
- Testing pending at Glific end
- Then we will pick for latency
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.