Add support performance measurement and statistics for Chat Session
Open
- Dominant language
- TypeScript
- Stars
- 193k
- Forks
- 42.4k
- PR merge metrics
- PR metrics pending
Description
We would like to add performance metrics for chat/agent, mainly to assess API performance.
Metrics:
- Time to first receive a token
- Time to generate tokens per second
Contributor guide
Assessment
This issue has not been assessed yet.