aws-samples / aws-samples/bedrock-chat

[BUG]: Mistral does not working

Open
#609 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
TypeScript
Stars
1.3k
Forks
535
Avg merge
1d 12h
Merged PRs (30d)
10

Description

## 🚨 **Please Note** 🚨

To ensure efficient investigation of the issue, please fill out the fields below with as much detail as possible. **Reports that do not follow this template may be closed without notification.** We appreciate your cooperation.

## Describe the bug

A clear and concise description of what the bug is.

Mistral with bedrock ConverseStream does'nt work.

[Cloud Watch Logs]
```
{
"schemaType": "ModelInvocationLog",
"schemaVersion": "1.0",
"timestamp": "2024-11-25T04:34:01Z",
"accountId": "241231359358",
"identity": {
"arn": "arn:aws:sts::241231359358:assumed-role/BedrockChatStack-WebSocketHandlerRole4D6EDDA6-ZlWJRBDYLEUo/BedrockChatStack-WebSocketHandler7115E6CA-tvD32M5nnzNp"
},
"region": "us-east-1",
"requestId": "84c8f065-8358-4eee-9ca3-4c99b067753d",
"operation": "ConverseStream",
"modelId": "mistral.mistral-large-2402-v1:0",
"errorCode": "ValidationException"
}
```

## To Reproduce

Steps to reproduce the behavior:

1. enable `enableMistral` in cdk.json
2. deploy cdk
3. select model with mistral
4. say hello in chat.

## Screenshots

If applicable, add screenshots to help explain your problem.
![Screenshot 2024-11-25 at 14 52 10](https://github.com/user-attachments/assets/b83c7fe6-7d23-4460-a7d8-846d5cd44e3b)

## Additional context

Add any other context about the problem here.

Contributor guide

Open the contributing guide

Research direction

Start with cdk.json and the deployment/model-selection path described in the reproduction steps; enable enableMistral and reproduce the failure while checking the provided CloudWatch ConverseStream log. Trace the ValidationException for mistral.mistral-large-2402-v1:0, and consider the issue done when selecting Mistral and sending a chat message produces a working streamed response.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.