Duke-GCB / Duke-GCB/DukeDSClient
4 stage upload process
Open
- Dominant language
- Python
- Stars
- 5
- Forks
- 6
- PR merge metrics
- No merged PRs in 30d
Description
> Yes. The way ddsclient uploads files is a two stage process. The first stage we upload small files - several at a time. The second stage we upload large files one at a time (with chunks be uploaded in parallel). Currently we sort the new files to the front within each stage.
> Should I break it up into 4 stages: upload small new, upload large new, upload small existing, upload large existing?
Eventually yes, but let's create an issue for that item.
_Originally posted by @dleehr in https://github.com/Duke-GCB/DukeDSClient/pull/271#issuecomment-540049128_
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.