open-mmlab / open-mmlab/mmengine

[Feature] Support dumping datasets to `pkl` file

Open
#896 2 comments 0 reactions 1 assignee View on GitHub

@RangiLyu is already working on this.

Since Jan 19, 2023.

  • #1037 by @shufanwu — open
community collaboration feature request
Dominant language
Python
Stars
1.5k
Forks
464
PR merge metrics
No merged PRs in 30d

Description

What's the feature?

Suggest adding a dump function to BaseDataset. This function will make the dataset more flexible. Users can first dump the dataset to a pkl file, and then reformat its structure to anther dataset type.

Users can dump the dataset like this:

dataset.dump('data_list.pkl')

Then, data_list can also be directly loaded

dataset.load('data_list.pkl')
Any other context?

No response

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.