S3 connection layer doesn't support buckets with large number of files
Open
Bug
Priority: Backlog
- Dominant language
- C++
- Stars
- 93
- Forks
- 34
- PR merge metrics
- No merged PRs in 30d
Description
Issue: The basic AWS S3 connection interface doesn't support listing files in an AWS bucket when the number of files exceeds a threshold (possibly 1000).
Solution: Need to implement continuation tokens for AWS request responses to handle this scenario.
Contributor guide
Assessment
This issue has not been assessed yet.