ianarawjo / ianarawjo/ChainForge

Error When Prompting Mistral/Mixtral Model from AWS Bedrock

Open
#264 7 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
3k
Forks
256
Avg merge
4h 40m
Merged PRs (30d)
22

Description

Description:
I successfully cloned the repository from the main branch and tested the application with LLMs deployed on Azure using the OpenAI resource, and everything worked as expected. However, I encountered an issue when attempting to prompt a Mistral model hosted on AWS Bedrock.

Steps to Reproduce:

- Cloned the repository from the main branch.
- Created temporary credentials on AWS for accessing the AWS Bedrock.
- Attempted to send prompts to the Mistral/Mixtral LLM models.
- Received the following error message for both model types.

Expected Behavior:
I expected that the prompts would be successfully processed by the Mistral/Mixtral models without any errors.

Observed Behavior:
When attempting to send prompts, the application failed to collect responses and suggested re-running the prompt node. The specific error logged was:
```
Errors collecting responses. Re-run prompt node to retry.
Mistral Mixtral: "c.get is not a function"
```

Environment:
Operating System: Ubuntu 22.04 + docker

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.