Azure / Azure/azureml-examples

Mistral with Images raises an `Internal Server Error`

Open
#3,619 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Jupyter Notebook
Stars
2k
Forks
1.7k
Avg merge
18h 18m
Merged PRs (30d)
2

Description

### Operating System

Windows

### Version Information

azure-ai-inference ==1.0.0b9
azure-core==1.34.0

### Steps to reproduce

Execute this this [notebook `Example (with image inputs)`](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/mistral/mistralai.ipynb).

### Expected behavior

I expect an LLM response describing the image.

### Actual behavior

When trying to reproduce the example with images in this [notebook](https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/mistral/mistralai.ipynb), the `resp.json()` object is None and the headers indicate an `model_error`. I can successfully process images, if I send base64 encoded images directly through the image_url field.

### Addition information

_No response_

Contributor guide

Open the contributing guide

Research direction

Start by running the `Example (with image inputs)` notebook linked in the issue with azure-ai-inference 1.0.0b9, then inspect the response around `resp.json()` and the `model_error` headers. Compare that path with the working base64 `image_url` input; done means the notebook returns an LLM response describing the image without an internal server error.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, jupyter-notebook, python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.