googleapis / googleapis/google-cloud-java

[java-storage] Allow customizing divideAndConquerThreshold in TransferManagerConfig

未关闭
#12,627 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
api: storage
主要语言
Java
星标
2.1k
派生
1.2k
平均合并
1 天 23 小时
30 天内合并 PR
157

描述

Thanks for stopping by to let us know something could be better!

**PLEASE READ**: If you have a support contract with Google, please create an issue in the [support console](https://cloud.google.com/support/) instead of filing on GitHub. This will ensure a timely response.

**Is your feature request related to a problem? Please describe.**

divideAndConquerThreshold is set to 128 MiB in DefaultQoS. There's no way to change this from any public methods. Our use case requires downloading files of arbitrary sizes concurrently, some < 128 MiB, some < 1 GiB, and some > 10+ GiB. We see that divideAndConquerThreshold adds overhead for these medium sized files.

**Describe the solution you'd like**

Allow defining divideAndConquerThreshold via public methods in TransferManagerConfig.

**Describe alternatives you've considered**

There's no way to accomplish this currently from what I can tell.

**Additional context**

Is there a reason 128 MiB was chosen?

贡献指南

打开贡献指南

调研方向

Start by inspecting TransferManagerConfig and DefaultQoS, especially how divideAndConquerThreshold is currently defined and how other configuration values are exposed. Add public configuration support for the threshold and update or add focused tests showing that a custom value is accepted and used for transfers of different sizes.

由索引模型根据 Issue 内容生成。

评估

技术栈
java
领域
cloud
Issue 类型
功能
难度
3/5
预计耗时
1-2 天
活跃度
停滞
描述清晰度
基本清楚
新手友好度
45/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。