Azure / Azure/ai-hub

Provide write-up for APIM scenarios with AI hub

Open
#18 0 comments 0 reactions 1 assignee Claimed by @victorar View on GitHub
enhancement good first issue
Dominant language
HCL
Stars
87
Forks
25
PR merge metrics
No merged PRs in 30d

Description

## Goal state

We need a detailed article that describes the various scenarios where APIM is adding value in context of Azure OpenAI.
Besides dynamic load balancing and retry/throttling logic etc., we must provide prescriptive guidance for known use-cases, such as:
* Combination of PTU and pay-as-you-go.
* Same as the above, where organisations can "start small & expand" without any dramatic changes required on the application side.
* Differen APIM policies to address different scenarios. We should ensure this is reflected and available as options in the reference implementation as we wrap things up.
* External vs Internal vs Hybrid
* Single region - and multiple regions

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.