aws-samples / aws-samples/bedrock-chat

[Feature Request] Private Streaming and Backend APIs

Open
#486 1 comment 2 reactions 1 assignee Claimed by @statefb View on GitHub
enhancement
Dominant language
TypeScript
Stars
1.3k
Forks
535
Avg merge
1d 12h
Merged PRs (30d)
10

Description

## Describe the solution you'd like

Create a deployment option that bundles all backend

## Why the solution needed

Many customers require any and all internal usage of generative AI to transit their corporate network. At present the use of HTTP API and Websocket API means that using this solution as-is is a non-starter.

Options include:
- Converting HTTP API to a REST API, thus allowing use of [private API](https://docs.aws.amazon.com/apigateway/latest/developerguide/apigateway-private-apis.html) ([done](https://github.com/ggallo/bedrock-claude-chat/commit/5f91571b6b0bea7a7937088ff9cfaff55d9c38b8))
- Convert the Streaming API to an ECS Service using [websockets](https://websockets.readthedocs.io/en/stable/)

## Additional context

You can reach me on Slack

## Implementation feasibility

Are you willing to discuss the solution with us, decide on the approach, and assist with the implementation?

- [X] Yes!
- [ ] No

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.