googleapis / googleapis/python-aiplatform

Introduce a non-global Vertex AI client

Open
#5,119 0 comments 0 reactions 0 assignees View on GitHub
api: vertex-ai type: feature request
Dominant language
Python
Stars
905
Forks
465
Avg merge
1d 13h
Merged PRs (30d)
44

Description

Currently, vertexai.init() sets global variables which is a limit in a multithreaded environment when you want to serve different models to the corresponding available regions. Having an instantiable client (as in your nodejs [client](https://cloud.google.com/vertex-ai/generative-ai/docs/reference/nodejs/latest/vertexai/vertexai) would solve the problem)

Contributor guide

Open the contributing guide

Research direction

Start with the vertexai.init() entry point and compare its global-state behavior with the linked Node.js Vertex AI client. Define the instantiable Python client’s scope and verify that separate clients can serve different models in different regions without shared configuration.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.