googleapis / googleapis/python-aiplatform
Vertex AI endpoint predict timeout feature for model prediction when using raw_predict
- Dominant language
- Python
- Stars
- 905
- Forks
- 465
- Avg merge
- 1d 13h
- Merged PRs (30d)
- 44
Description
Thanks for stopping by to let us know something could be better!
**PLEASE READ**: If you have a support contract with Google, please create an issue in the [support console](https://cloud.google.com/support/) instead of filing on GitHub. This will ensure a timely response.
**Is your feature request related to a problem? Please describe.**
Currently we wanted to use raw predictions in our pipelines but having a timeout value due to some business constraints.
**Describe the solution you'd like**
vertex ai endpoint has option to give raw_prediction as response, but the timeout doesn't work, setting the timeout should be respected in when real_predict is true.
**Describe alternatives you've considered**
We have set timeout explicitly.
**Additional context**
this is related to endpoint functionality of vertex ai python package
Contributor guide
Assessment
This issue has not been assessed yet.