googleapis / googleapis/python-aiplatform

Vertex AI endpoint predict timeout feature for model prediction when using raw_predict

Open
#2,663 1 comment 0 reactions 0 assignees View on GitHub
api: vertex-ai type: feature request
Dominant language
Python
Stars
905
Forks
465
Avg merge
1d 13h
Merged PRs (30d)
44

Description

Thanks for stopping by to let us know something could be better!

**PLEASE READ**: If you have a support contract with Google, please create an issue in the [support console](https://cloud.google.com/support/) instead of filing on GitHub. This will ensure a timely response.

**Is your feature request related to a problem? Please describe.**
Currently we wanted to use raw predictions in our pipelines but having a timeout value due to some business constraints.
**Describe the solution you'd like**
vertex ai endpoint has option to give raw_prediction as response, but the timeout doesn't work, setting the timeout should be respected in when real_predict is true.
**Describe alternatives you've considered**
We have set timeout explicitly.
**Additional context**
this is related to endpoint functionality of vertex ai python package

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.