huggingface / huggingface/leLab

Feature Request: Merge multiple local datasets into one

Open
#109 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
171
Forks
60
Avg merge
1d 52m
Merged PRs (30d)
5

Description

There's no way to combine two recorded datasets into one. If you recorded the same task in separate sessions (or on separate days), you're stuck with separate `repo_id`s — you can't train on them as a single dataset without merging manually.

`lerobot.datasets.dataset_tools.merge_datasets()` already does this on the lerobot side (concatenates videos + data files into a new dataset). LeLab just doesn't expose it anywhere.

Would like a "Merge" action on the dataset browser: pick two or more local datasets, give the merged result a name, and it writes a new dataset to the local cache.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in the dataset browser and trace how local datasets are selected, named, and written to the cache. Read lerobot.datasets.dataset_tools.merge_datasets() to understand its inputs and outputs; done means a Merge action accepts two or more local datasets, asks for a name, and creates the merged dataset locally.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
data, frontend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.