googleapis / googleapis/python-aiplatform

Proxy settings configuration for Vertex AI SDK

Open
#4,810 0 comments 0 reactions 0 assignees View on GitHub
api: vertex-ai
Dominant language
Python
Stars
905
Forks
465
Avg merge
1d 13h
Merged PRs (30d)
44

Description

Hello !

I'm using the Vertex AI Python SDK with a generative model in my application as follows:

```python
import vertexai
vertexai.init(...)
model = GenerativeModel("...")
generation_config = GenerationConfig("...")
model.generate_content(..., stream=True)
```

I want the `generate_content` method to route its requests through a proxy.

From my research, I found that, with this library, proxies can be configured using the `https_proxy` and `http_proxy` environment variables or programmatically within the Python code, for example:

```python
import os
os.environ["https_proxy"] = "http://my_proxy:8080"
```

However, I would like to know if there is another way to configure a proxy for this call without relying on `os.environ` or setting environment variables.

This is important because modifying `os.environ` or system-level environment variables could unintentionally affect other parts of the application.
I'd appreciate any suggestions on alternative approaches.
Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.