Kong / Kong/developer.konghq.com

AIGW load balancing overview motivation

Open
#5,496 0 comments 0 reactions 1 assignee Claimed by @jbaross View on GitHub
internal product:ai-gateway
Dominant language
Ruby
Stars
28
Forks
121
Avg merge
1d 4h
Merged PRs (30d)
313

Description

## Jobs to be done (optional)

Following https://app.kapa.ai/93b55f65-cffb-4d0b-9da7-c8915a838dce/conversations/82f2e222-2209-49f2-a84e-4b3052bd355a and aligning with 2.0 entities model (so loadballencing is configured on the model not on AI proxy explicitly)

## Definition of done

Pages such as https://developer.konghq.com/ai-gateway/load-balancing/ should include a brief 1-2 line motivation for load balancing as such distinguishing it from other routing mechanisms

## Size

- S (Small). Example: fixing a broken link, updating wording in an FAQ or paragraph

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.