GoogleCloudPlatform / GoogleCloudPlatform/cloud-networking-solutions

Add agentgateway as an AI Inference Gateway

Open
#178 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
HCL
Stars
12
Forks
21
Avg merge
1d 11h
Merged PRs (30d)
7

Description

The [Networking for AI Inference Model Serving](https://github.com/GoogleCloudPlatform/cloud-networking-solutions/tree/main/reference-architectures/networking-for-ai-inference) reference architecture supports GKE Inference Gateway and Self Managed Options. [Agentgateway](https://agentgateway.dev/) is an open source AI gateway that can support both options or can be added as a third option.

Contributor guide

Open the contributing guide

Research direction

Start by reading the reference architecture in reference-architectures/networking-for-ai-inference and reviewing how the GKE Inference Gateway and self-managed options are represented. Determine whether agentgateway should support those options or appear as a third option; done means the architecture clearly documents agentgateway and its supported deployment path.

Written by the indexing model from the issue text.

Assessment

Tech stack
google-cloud, kubernetes
Domain
cloud, infrastructure
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.