Azure / Azure/azure-storage-cpplite

Dowload performance is slow when downloading 10 K packages

Open
#118 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
26
Forks
50
PR merge metrics
No merged PRs in 30d

Description

@Jinming-Hu

I have used blob_client and blob_wrap api for Downloading 10000+ Packages and found some issues.

BlobClient download_blob_to_stream
BlobWrap download_blob_to_file
I set the concurrencylimit as 16, But I noticed that at one point if we used download_blob_to_stream, the Download becomes very slow, and if we go with the download_blob_to_file where CPU usages increased and make the Gateway slow. And the slowness I observed after downloading the 1000 packages after that it becomes slow.
Can you please suggest the way to use this effetively and also suggest How we can improve the performance .

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.