googleapis / googleapis/python-aiplatform
Vertex AI endpoint predict timeout feature for model prediction when using raw_predict
- Dominant language
- Python
- Stars
- 905
- Forks
- 465
- Avg merge
- 1d 13h
- Merged PRs (30d)
- 44
Description
Thanks for stopping by to let us know something could be better!
**PLEASE READ**: If you have a support contract with Google, please create an issue in the [support console](https://cloud.google.com/support/) instead of filing on GitHub. This will ensure a timely response.
**Is your feature request related to a problem? Please describe.**
Currently we wanted to use raw predictions in our pipelines but having a timeout value due to some business constraints.
**Describe the solution you'd like**
vertex ai endpoint has option to give raw_prediction as response, but the timeout doesn't work, setting the timeout should be respected in when real_predict is true.
**Describe alternatives you've considered**
We have set timeout explicitly.
**Additional context**
this is related to endpoint functionality of vertex ai python package
Contributor guide
Research direction
Start by tracing the Vertex AI endpoint prediction path for raw_predict and the real_predict=true case, then inspect how the explicitly supplied timeout is handled. Verify the behavior with a focused test showing that a raw prediction honors the requested timeout.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 40/100