Azure / Azure/azure-sdk-for-python

Azure AI Inference SDK fails to complete chat completion with gpt-4.1

Open
#40,539 4 comments 0 reactions 1 assignee Assigned to @trangevi View on GitHub
AI Model Inference Client customer-reported needs-team-attention question Service Attention
Dominant language
Python
Stars
5.6k
Forks
3.4k
Avg merge
1d 21h
Merged PRs (30d)
193

Description

- **Package Name**: azure-ai-inference
- **Package Version**: 1.0.0b9
- **Operating System**: Windows 11
- **Python Version**: 3.12.9

**Describe the bug**
Chat completion request fails with
> **ERROR:**
> JSONDecodeError: Expecting value: line 1 column 1 (char 0)

**To Reproduce**
Steps to reproduce the behavior:
```python
client = ChatCompletionsClient(
endpoint=endpoint,
credential=AzureKeyCredential(os.getenv("AZURE_OPENAI_API_KEY"))
)

response = client.complete(
messages=[
SystemMessage(content="You are a helpful assistant."),
UserMessage(content="Where is Zurich?")
],
model="gpt-4.1"
)
```

**Expected behavior**
Return the chat completion result

**Screenshots**
n/a

**Additional context**
This works fine with any other AOAI model, it only fails with gpt-4.1

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.