aws / aws/aws-sdk-net

DynamoDBContext BatchGet in Parallel

Open
#3,592 3 comments 0 reactions 0 assignees View on GitHub
dynamodb feature-request p2 queued
Dominant language
C#
Stars
140
Forks
891
Avg merge
21h 51m
Merged PRs (30d)
10

Description

### Describe the feature

Currently `DynamoDBContext`'s `BatchGet` functionality will chunk requests with more keys than the DDB BatchGet limit into multiple requests which is great but it seems to process them in series. Ideally all the BatchGet chunks would be processed in parallel.

### Use Case

Using `DynamoDBContext` to perform a `BatchGet` operation with more keys than the DDB BatchGet API allows.

### Proposed Solution

When using `DynamoDBContext` to BatchGet with many keys such that the SDK chunks the request into multiple API calls, invoke those calls in parallel instead of in series.

### Other Information

_No response_

### Acknowledgements

- [ ] I may be able to implement this feature request
- [ ] This feature might incur a breaking change

### AWS .NET SDK and/or Package version used

AWSSDK.DynamoDBv2

### Targeted .NET Platform

.NET 8 and up

### Operating System and version

N/A

Contributor guide

Open the contributing guide

Research direction

Start by locating the DynamoDBContext BatchGet implementation and its handling of requests larger than the DynamoDB BatchGet limit. Read how the chunks are currently processed, then identify the relevant tests for BatchGet behavior. Done means oversized BatchGet requests process their chunks in parallel on .NET 8 and up.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, csharp
Domain
cloud, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.