spring-projects / spring-projects/spring-ai
(Feature request) Add support for latency optimized performanceConfig (AWS bedrock converse)
Open
Nobody has claimed this yet.
status: waiting-for-triage
- Dominant language
- Java
- Stars
- 9.5k
- Forks
- 2.9k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 6
Description
AWS Bedrock has support for latency optimization that speeds up response times for certain models. Would love to be able to take advantage of this using Spring AI.
AWS Docs - https://docs.aws.amazon.com/bedrock/latest/userguide/latency-optimized-inference.html
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the AWS Bedrock Converse integration and review the linked AWS latency-optimized inference documentation. Determine how latency-optimized performanceConfig should be exposed in Spring AI, and verify that Converse requests can use it as described by AWS.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, java
- Domain
- ai, backend-api-design
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100