huggingface / huggingface/VLAb
Quick Start demo is failing
- Dominant language
- Python
- Stars
- 201
- Forks
- 15
- PR merge metrics
- No merged PRs in 30d
Description
When running the quickstart demo given in the README...
`accelerate launch --config_file accelerate_configs/single_gpu.yaml src/lerobot/scripts/train.py --policy.type=smolvla2 --policy.repo_id=HuggingFaceTB/SmolVLM2-500M-Video-Instruct --dataset.repo_id="Beegbrain/pick_lemon_and_drop_in_bowl" --output_dir="./outputs/training" --batch_size=8 --steps=10000 --wandb.enable=true --wandb.project="smolvla2-quickstart"`
I get the following error... **What could be going wrong?**
`Traceback (most recent call last):
File "/home/user/VLAb/src/lerobot/scripts/train.py", line 377, in
train()
File "/home/user/VLAb/src/lerobot/configs/parser.py", line 226, in wrapper_inner
response = fn(cfg, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/VLAb/src/lerobot/scripts/train.py", line 271, in train
batch = next(dl_iter)
^^^^^^^^^^^^^
File "/home/user/VLAb/src/lerobot/datasets/utils.py", line 642, in cycle
yield next(iterator)
^^^^^^^^^^^^^^
File "/home/user/miniconda3/envs/vlab/lib/python3.11/site-packages/accelerate/data_loader.py", line 567, in __iter__
current_batch = next(dataloader_iter)
^^^^^^^^^^^^^^^^^^^^^
File "/home/user/miniconda3/envs/vlab/lib/python3.11/site-packages/torch/utils/data/dataloader.py", line 701, in __next__
data = self._next_data()
^^^^^^^^^^^^^^^^^
File "/home/user/miniconda3/envs/vlab/lib/python3.11/site-packages/torch/utils/data/dataloader.py", line 1465, in _next_data
return self._process_data(data)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/miniconda3/envs/vlab/lib/python3.11/site-packages/torch/utils/data/dataloader.py", line 1491, in _process_data
data.reraise()
File "/home/user/miniconda3/envs/vlab/lib/python3.11/site-packages/torch/_utils.py", line 715, in reraise
raise exception
TypeError: Caught TypeError in DataLoader worker process 0.
Original Traceback (most recent call last):
File "/home/user/miniconda3/envs/vlab/lib/python3.11/site-packages/torch/utils/data/_utils/worker.py", line 351, in _worker_loop
data = fetcher.fetch(index) # type: ignore[possibly-undefined]
^^^^^^^^^^^^^^^^^^^^
File "/home/user/miniconda3/envs/vlab/lib/python3.11/site-packages/torch/utils/data/_utils/fetch.py", line 52, in fetch
data = [self.dataset[idx] for idx in possibly_batched_index]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/miniconda3/envs/vlab/lib/python3.11/site-packages/torch/utils/data/_utils/fetch.py", line 52, in
data = [self.dataset[idx] for idx in possibly_batched_index]
~~~~~~~~~~~~^^^^^
File "/home/user/VLAb/src/lerobot/datasets/lerobot_dataset.py", line 906, in __getitem__
query_result = self._query_hf_dataset(query_indices)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/VLAb/src/lerobot/datasets/lerobot_dataset.py", line 870, in _query_hf_dataset
queries[key] = torch.stack(self.hf_dataset.select(q_idx)[key])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: stack(): argument 'tensors' (position 1) must be tuple of Tensors, not Column`
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.