CodeForPhilly / CodeForPhilly/balancer-main
Speed up LLM (Insights, Chatbot and Ask All Papers) evaluations using asyncio
Open
- Dominant language
- TypeScript
- Stars
- 21
- Forks
- 19
- PR merge metrics
- No merged PRs in 30d
Description
Test Cases | With asyncio | Without asyncio | Speed Improvement
-- | -- | -- | --
10 | 19.0 seconds | 104.2 seconds | 5.5x faster
20 | 29.7 seconds | 205.8 seconds | 6.9x faster
40 | 80.2 seconds | 427.2 seconds | 5.3x faster
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.