Set timeouts on requests made internally by the `inference`
Open
Nobody has claimed this yet.
bug
- Dominant language
- Python
- Stars
- 2.5k
- Forks
- 319
- Avg merge
- 1d 14h
- Merged PRs (30d)
- 133
Description
Search before asking
- I have searched the Inference issues and found no similar bug report.
Bug
Currently, there is no control over timeouts while making internal requests in library:
- we need to expose such control knob from functions making request
- set reasonable default that can be controlled via env
otherwise we may end up having issues with such components likeInferencePipelineattempting to communicate with RF backend - for instance while running workflows
Environment
No response
Minimal Reproducible Example
No response
Additional
No response
Are you willing to submit a PR?
- Yes I'd like to help by submitting a PR!
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the functions that make internal requests and the InferencePipeline path that communicates with the RF backend. Trace how request settings are passed and where environment configuration could apply; the work is done when callers can control timeouts and a reasonable default is configurable through the environment.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend, networking
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100