aws / aws/aws-cli

[CRT] - Allow setting max bandwidth limit for S3 transfers

Open
#8,974 4 comments 0 reactions 0 assignees View on GitHub
configuration feature-request p2 s3
Dominant language
Python
Stars
17.3k
Forks
4.6k
Avg merge
1d 2h
Merged PRs (30d)
13

Description

### Describe the bug

I'm trying to limit S3 bandwidth for CRT runtime described in https://aws.amazon.com/blogs/storage/improving-amazon-s3-throughput-for-the-aws-cli-and-boto3-with-the-aws-common-runtime/

I used the following command (from the article)

```
aws configure set s3.target_bandwidth 50MB/s
```

despite that I see much higher bandwidth (limited by hard disk drive actually)

image

aws cli version: `aws-cli/2.17.61 Python/3.12.6 Windows/2022Server exec-env/EC2 exe/AMD64`

in classic (non crt) mode bandwidth limiting works like a charm.

### Regression Issue

- [ ] Select this option if this issue appears to be a regression.

### Expected Behavior

limiting bandwidth in crt mode

### Current Behavior

not limiting (even configured as per article)

### Reproduction Steps

install aws cli
aws configure set s3.preferred_transfer_client crt
aws configure set s3.target_bandwidth 50MB/s

copy files to s3, verify speed

### Possible Solution

_No response_

### Additional Information/Context

_No response_

### CLI version used

aws-cli/2.17.61 Python/3.12.6 Windows/2022Server exec-env/EC2 exe/AMD64

### Environment details (OS name and version, etc.)

win 2022

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.