Azure / Azure/azureml-examples

LiteLLM Example in mistral docs wrong

Open
#3,024 14 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Jupyter Notebook
Stars
2k
Forks
1.7k
Avg merge
18h 18m
Merged PRs (30d)
2

Description

### Operating System

MacOS

### Version Information

not relevant

### Steps to reproduce

https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/mistral/litellm.ipynb
@santiagxf Thanks for showing an example with litellm, but the docs are wrong

Here's how to use litellm with mistral
https://docs.litellm.ai/docs/providers/mistral

```python
from litellm import completion
import os

os.environ['MISTRAL_API_KEY'] = ""
response = completion(
model="mistral/mistral-tiny",
api_base="your-api-base",
messages=[
{"role": "user", "content": "hello from litellm"}
],
)
print(response)
```

### Expected behavior

-

### Actual behavior

-

### Addition information

_No response_

Contributor guide

Open the contributing guide

Research direction

Open sdk/python/foundation-models/mistral/litellm.ipynb and compare its LiteLLM usage with the linked LiteLLM Mistral provider documentation. Check the notebook's model, API base, environment variable, and completion example against the issue's reference snippet. Done means the Mistral LiteLLM example matches the documented usage and the notebook remains runnable.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook, python
Domain
documentation
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.