Azure / Azure/azure-sdk-for-python

AzureAIInference: support response format schema

Open
#40,793 2 comments 0 reactions 1 assignee Claimed by @trangevi View on GitHub
AI Model Inference Client customer-reported feature-request needs-team-attention Service Attention
Dominant language
Python
Stars
5.6k
Forks
3.4k
Avg merge
1d 21h
Merged PRs (30d)
193

Description

**Is your feature request related to a problem? Please describe.**
I'm using [semantic kernel](https://github.com/microsoft/semantic-kernel) for my prompts.
I've been using mostly Azure OpenAI models, which works fine for json structured output.
The issue I have is that, for a model like mistral, I can't get structured output working.
The reason is that AzureAIInference currently only support the "old way": json_object, no a specific format.
The issue was first opened on semantic-kernel repo: https://github.com/microsoft/semantic-kernel/issues/11025#issuecomment-2791460610

**Describe the solution you'd like**
AzureAIInference to implement a schema base response format so that it can be ported to semantic kernel.

**Describe alternatives you've considered**
Not using Azure models?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.