googleapis / googleapis/python-aiplatform

Vertex AI endpoint predict timeout feature for model prediction when using raw_predict

Open
#2,663 1 comment 0 reactions 0 assignees View on GitHub
api: vertex-ai type: feature request
Dominant language
Python
Stars
905
Forks
465
Avg merge
1d 13h
Merged PRs (30d)
44

Description

Thanks for stopping by to let us know something could be better!

**PLEASE READ**: If you have a support contract with Google, please create an issue in the [support console](https://cloud.google.com/support/) instead of filing on GitHub. This will ensure a timely response.

**Is your feature request related to a problem? Please describe.**
Currently we wanted to use raw predictions in our pipelines but having a timeout value due to some business constraints.
**Describe the solution you'd like**
vertex ai endpoint has option to give raw_prediction as response, but the timeout doesn't work, setting the timeout should be respected in when real_predict is true.
**Describe alternatives you've considered**
We have set timeout explicitly.
**Additional context**
this is related to endpoint functionality of vertex ai python package

Contributor guide

Open the contributing guide

Research direction

Start by tracing the Vertex AI endpoint prediction path for raw_predict and the real_predict=true case, then inspect how the explicitly supplied timeout is handled. Verify the behavior with a focused test showing that a raw prediction honors the requested timeout.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
40/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.