aws-samples / aws-samples/foundational-llm-chat

How to add a marketplace deployment model?

Open
#3 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
36
Forks
11
PR merge metrics
No merged PRs in 30d

Description

I am playing around with Bedrock's marketplace deployment feature. From the model catalog, I deployed the Mistral Pixtral model. Do you have any instructions on how to get the app to use the deployed model? I tried copying the endpoint ARN into config.json, but that didn't do the trick.

Contributor guide

Open the contributing guide

Research direction

Start by reading config.json and the app's existing Bedrock setup to determine how model endpoints are configured. Verify whether a marketplace deployment ARN can be represented by the current configuration, then document the required steps and confirm that the app uses the deployed Mistral Pixtral model.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
ai, cloud
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.