ianarawjo / ianarawjo/ChainForge
Error When Prompting Mistral/Mixtral Model from AWS Bedrock
- Dominant language
- TypeScript
- Stars
- 3k
- Forks
- 256
- Avg merge
- 4h 40m
- Merged PRs (30d)
- 22
Description
Description:
I successfully cloned the repository from the main branch and tested the application with LLMs deployed on Azure using the OpenAI resource, and everything worked as expected. However, I encountered an issue when attempting to prompt a Mistral model hosted on AWS Bedrock.
Steps to Reproduce:
- Cloned the repository from the main branch.
- Created temporary credentials on AWS for accessing the AWS Bedrock.
- Attempted to send prompts to the Mistral/Mixtral LLM models.
- Received the following error message for both model types.
Expected Behavior:
I expected that the prompts would be successfully processed by the Mistral/Mixtral models without any errors.
Observed Behavior:
When attempting to send prompts, the application failed to collect responses and suggested re-running the prompt node. The specific error logged was:
```
Errors collecting responses. Re-run prompt node to retry.
Mistral Mixtral: "c.get is not a function"
```
Environment:
Operating System: Ubuntu 22.04 + docker
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.