Azure / Azure/azure-rest-api-specs

[FEATURE REQ] Structured Output support for Non-OpenAI models

Open
#34,859 0 comments 1 reaction 0 assignees View on GitHub
AI Model Inference customer-reported data-plane feature-request question Service Attention
Dominant language
TypeSpec
Stars
3.1k
Forks
5.9k
Avg merge
3d 2h
Merged PRs (30d)
424

Description

### API Spec link

https://github.com/Azure/azure-rest-api-specs/blob/main/specification/ai/data-plane/ModelInference/preview/2024-05-01-preview/openapi.json

### API Spec version

2024-05-01-preview

### Please describe the feature.

Unable to use structured output for non-openai models.

The api version is struck at `2024-05-01-preview`. Can you please add support for Structured Output so I can integrate Azure AI foundry in my app.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the linked ModelInference OpenAPI specification for version 2024-05-01-preview and compare its current support for non-OpenAI models. Determine how structured output should be represented for those models; the work is done when the specification exposes that capability clearly in the preview API.

Written by the indexing model from the issue text.

Assessment

Tech stack
openapi
Domain
api
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.