[FEA] Avoid read timeout=30 by new setting in cuopt_sh_client.CuOptServiceSelfHostClient
Nobody has claimed this yet.
- Dominant language
- Cuda
- Stars
- 1k
- Forks
- 233
- Avg merge
- 4d 4h
- Merged PRs (30d)
- 95
Description
I tried solving some big LPs on a self-hosted server, and I sometimes got
HTTPConnectionPool(host='localhost', port=5000): Read timed out. (read timeout=30)
I checked, and it looks like this 30s timeout is hardcoded:
https://github.com/NVIDIA/cuopt/blob/89aef1b59e56a6a3e5fe816b66448da70dbae107/python/cuopt_self_hosted/cuopt_sh_client/cuopt_self_host_client.py#L597
It would be nice if we could change or disable this timeout with the interface of cuopt_sh_client.CuOptServiceSelfHostClient.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The hardcoded timeout is in python/cuopt_self_hosted/cuopt_sh_client/cuopt_self_host_client.py around line 597; start there and inspect how CuOptServiceSelfHostClient exposes request settings. Make the read timeout configurable or disable-able through that interface, and verify requests no longer use a fixed 30-second limit.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api
- Issue type
- Feature
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100