Can timeout be added for LLM call
Open
- Dominant language
- Python
- Stars
- 38.6k
- Forks
- 2.7k
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 3
Description
While calling LLM with large amount of data, client is getting timed out. Can we provide feature to add custom time out?
Contributor guide
Assessment
This issue has not been assessed yet.