GoogleCloudPlatform / GoogleCloudPlatform/gsutil
gsutil in-place GCS bucket compression feature
- Dominant language
- Python
- Stars
- 918
- Forks
- 335
- PR merge metrics
- No merged PRs in 30d
Description
Requesting a new feature!!
Problem Statement:
gsutil lacks a feature to allow in-place compression for same bucket.
For example, if you have a bucket named 'test-bucket' and you want to compress large amount of data in the same bucket, you either have to download or transfer the data out of the bucket to some other services in GCP like VM Instance's File System or local system, then fire up the gsutil command to upload the same data to bucket, you have apply the '-z/Z' argument for compression.
Or worst case, you have to implement a pipeline for bulk compression like with Data Flow Service in GCP or custom program.
It could be possible that I am not aware of any such functionality but if there isn't none, would like to work on creating such feature based on suggestions.
Thanks!!!
Contributor guide
Assessment
This issue has not been assessed yet.