FormidableLabs / FormidableLabs/serverless-jetpack

Feature: Put a promise queue around file reading.

Open
#75 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
JavaScript
Stars
281
Forks
14
PR merge metrics
No merged PRs in 30d

Description

In bundling, we read all files into memory (and stat them). This can be a limitation we don't necessarily need. Our actual constraints:

- Read files in order.
- As file contents become available, do `zip.append` in sorted order.
- Wait on any file contents before further parallel reading until we finish `zip.append` to `n` concurrency.

See: `p-limit`, `p-queue`, etc.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.