Kong / Kong/developer.konghq.com

AI Gateway [2.0]: Document dynamic multimodal LLM pricing for AI Proxy Advanced

Open
#4,899 1 comment 0 reactions 0 assignees View on GitHub
internal priority: high product:ai-gateway release-docs
Dominant language
Ruby
Stars
28
Forks
121
Avg merge
1d 4h
Merged PRs (30d)
313

Description

We're introducing aew `config.pricing` record on `ai-proxy-advanced` with inline JSON catalog (`pricing.enabled`, `pricing.models`). Adds per-modality cost fields (text, audio, image, video), `cache_read_per_token`, and `cache_write_per_token`. Inline pricing overrides static `model.options.input_cost` / `output_cost`.

DoD:

* Reference update: new `config.pricing` fields, catalog entry shape, validation rules.
* Full pricing field set, including modality-specific and cache fields.
* Resolution order: inline match, then `model.options`, then zero. Pricing failures don't block requests.
* Two config examples: inline catalog enabled, and fallback path with `enabled: false`.
* Limitations: `cache_write_per_token` schema-only (not calculated), no per-modality or cached-token metrics surfaced, embeddings folded into text input, realtime reuses multimodal schema.

TBD: How this will work with AI GW 2.0

Contributor guide

No contributing guide indexed for this repository

Research direction

Locate the AI Proxy Advanced reference documentation and its existing configuration examples, then read how model pricing is currently described. Document the config.pricing fields, catalog shape, validation, resolution order, examples, and stated limitations; done means each DoD item is covered without resolving the AI Gateway 2.0 TBD.

Written by the indexing model from the issue text.

Assessment

Domain
ai, documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.