iterative / iterative/ldb-resources

`Workflow`: Missing guidance for splitting datasets

Open
#14 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
27
Forks
7
PR merge metrics
No merged PRs in 30d

Description

In many practical machine learning workflows, splitting a dataset into subsets is a common operation.

For example, in the data-centric ai competition 2 different splits (train, validation) are expected to be submitted.
Different strategies for generating those splits might be tried and I would expect LDB to support these iterations.

I didn't find any guidance on how to perform these splitting iterations as part of the LDB workflow. Does the recommended workflow depend on https://github.com/iterative/ldb/issues/88 ?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.