googleapis / googleapis/google-cloud-java

[java-storage] Allow customizing divideAndConquerThreshold in TransferManagerConfig

Open
#12,627 0 comments 0 reactions 0 assignees View on GitHub
api: storage
Dominant language
Java
Stars
2.1k
Forks
1.2k
Avg merge
1d 23h
Merged PRs (30d)
154

Description

Thanks for stopping by to let us know something could be better!

**PLEASE READ**: If you have a support contract with Google, please create an issue in the [support console](https://cloud.google.com/support/) instead of filing on GitHub. This will ensure a timely response.

**Is your feature request related to a problem? Please describe.**

divideAndConquerThreshold is set to 128 MiB in DefaultQoS. There's no way to change this from any public methods. Our use case requires downloading files of arbitrary sizes concurrently, some < 128 MiB, some < 1 GiB, and some > 10+ GiB. We see that divideAndConquerThreshold adds overhead for these medium sized files.

**Describe the solution you'd like**

Allow defining divideAndConquerThreshold via public methods in TransferManagerConfig.

**Describe alternatives you've considered**

There's no way to accomplish this currently from what I can tell.

**Additional context**

Is there a reason 128 MiB was chosen?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.