JuliaML / JuliaML/MLDatasets.jl

unpack compressed files instead of streaming through them

Open
#122 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Julia
Stars
239
Forks
51
PR merge metrics
No merged PRs in 30d

Description

We could drop the dependence on `GZip`, which is not actively maintained, by just calling `DataDeps.unpack` (which relies on the p7zip binary) to uncompress files. It would be easy to change the MNISTReader & co. to just do that.

This could solve issues like #118.

Additionally, we may want to go in the direction of saving processed versions of the datasets (e.g. a JLD2 save of the dataset object itself) for faster I/O.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.