huggingface / huggingface/lerobot

Question regarding downsampling and resizing dataset

Open
#2,124 2 comments 1 reaction 0 assignees View on GitHub
dataset good first issue question
Dominant language
Python
Stars
27.5k
Forks
5.7k
Avg merge
4d 33m
Merged PRs (30d)
29

Description

Hi,

Thank you for providing this wonderful library! I was curious about how one can take an existing dataset (collected or downloaded) and modify the fps (downsample, resize images, or delete specific episodes (for v3) prior to policy training. I am finding this tricky to do particularly when the dataset is not loaded in code but provided as a parameter to lerobot-train. I've spent time digging around the codebase but didn't see a way that doesn't involve loading the dataset in script first and adjusting this (for resizing, not sure about downsampling fps). Does the codebase provide utility functions for this? Thanks!

Contributor guide

Open the contributing guide

Research direction

Start by tracing the lerobot-train dataset parameter and the existing dataset-loading path. Check how resizing, FPS downsampling, and episode deletion are currently handled, including the user's observation that resizing requires a script. Done should be a clear supported workflow or a scoped utility proposal for preprocessing datasets before policy training.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.