freeCodeCamp / freeCodeCamp/devdocs

Uncompress s3://devdocs-downloads/foo.tar.gz to s3://devdocs-documents/foo on s3?

Open
#1,639 1 comment 0 reactions 1 assignee Claimed by @ojeytonwilliams View on GitHub
feature
Dominant language
Ruby
Stars
39.5k
Forks
2.6k
Avg merge
4d 32m
Merged PRs (30d)
13

Description

Hi Oliver,

Uploading to s3://devdocs-documents/ takes a very long time when a lot of files are involved (for instance, `dom` amounts to 6852 files).

Is it feasible/possible upload only s3://devdocs-downloads/foo.tar.gz and have s3 automatically uncompress the documentation package to s3://devdocs-documents/foo? I found https://multiaki.medium.com/unzipping-s3-files-back-to-s3-without-uncompressing-entire-file-streaming-82f662b5065a, but don't know how hard/reliable this s3 setup is...

Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.