emscripten-core / emscripten-core/emscripten

[feature request] Automatic chunking of data files by file_packager and FS (and potentially wasm files as well?)

Open
#12,342 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
27.6k
Forks
3.6k
Avg merge
1d 1h
Merged PRs (30d)
105

Description

It would be nice if file_packager / FS supported configurable chunking of produced data files. This would be beneficial for browser caching and for dealing with compressed files >2Gb (all individual files are < 2Gb).

This is currently possible by manual chunking of directories, which is already not bad, but would be better if this was automatic / configurable, or at least if there was some recipe for this in docs.

TensorFlow.js does it (at least couple years ago) for distribution of the models

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.