facebookresearch / facebookresearch/seamless_interaction
Error when using `download_s3.py`
- Dominant language
- Python
- Stars
- 413
- Forks
- 31
- PR merge metrics
- No merged PRs in 30d
Description
Hi there,
Excellent work!!
But when I tried to use `download_single_example("V00_S0970_I00001220_P0602A")` to download a single example, errors occured as below. But things went ok when using `download_single_example("V01_S0223_I00000127_P1505")`.
```
🔍 S3 Download Options with Intelligent Sampling:
1. Single example (~100MB) - Quick exploration
2. Interaction pair (~200MB) - Conversational dynamics
3. Sample set (~1GB) - Initial prototyping
4. Session exploration (~400MB/session) - Deep context study
💡 All options auto-sample from preferred vendors if no keys provided
Preferred: V00, V01 (smaller files)
Avoided: V03 (larger 100MB-800MB videos)
📍 You can also specify exact keys:
Interaction key: V00_S0809_I00000582
Session key: V00_S0809
2025-11-29 15:56:48,099 - INFO - Loaded filelist with 129370 entries
2025-11-29 15:56:48,105 - INFO - Found 33 files for V00_S0970_I00001220_P0602A
2025-11-29 15:56:51,498 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/smplh/global_orient/V00_S0970_I00001220_P0602A.npy:
2025-11-29 15:56:51,540 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/smplh/is_valid/V00_S0970_I00001220_P0602A.npy:
2025-11-29 15:56:51,622 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/smplh/right_hand_pose/V00_S0970_I00001220_P0602A.npy:
2025-11-29 15:56:51,634 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/smplh/translation/V00_S0970_I00001220_P0602A.npy:
2025-11-29 15:56:52,613 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/boxes_and_keypoints/keypoints/V00_S0970_I00001220_P0602A.npy:
2025-11-29 15:56:53,205 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/movement/EmotionArousalToken/V00_S0970_I00001220_P0602A.npy:
2025-11-29 15:56:54,361 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/movement/EmotionValenceToken/V00_S0970_I00001220_P0602A.npy:
2025-11-29 15:56:54,771 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/movement/expression/V00_S0970_I00001220_P0602A.npy:
2025-11-29 15:57:00,346 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/metadata/transcript/V00_S0970_I00001220_P0602A.jsonl:
2025-11-29 15:57:00,346 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/movement/emotion_scores/V00_S0970_I00001220_P0602A.npy:
2025-11-29 15:57:00,717 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/metadata/vad/V00_S0970_I00001220_P0602A.jsonl:
2025-11-29 15:57:00,895 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/annotations/1P-IS/V00_S0970_I00001220_P0602A.json:
2025-11-29 15:57:01,273 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/annotations/1P-R/V00_S0970_I00001220_P0602A.json:
2025-11-29 15:57:02,488 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/annotations/3P-R/V00_S0970_I00001220_P0602A.json: Extra data: line 2 column 1 (char 141)
2025-11-29 15:57:02,493 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/annotations/3P-IS/V00_S0970_I00001220_P0602A.json: Extra data: line 2 column 1 (char 92)
2025-11-29 15:57:02,896 - ERROR - Failed to download https://dl.fbaipublicfiles.com/seamless_interaction/improvised/train/annotations/3P-V/V00_S0970_I00001220_P0602A.json: Extra data: line 2 column 1 (char 170)
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "/data2/ruiran/.conda/envs/seamlessinteraction/lib/python3.10/multiprocessing/pool.py", line 125, in worker
result = (True, func(*args, **kwds))
File "/data2/ruiran/.conda/envs/seamlessinteraction/lib/python3.10/multiprocessing/pool.py", line 51, in starmapstar
return list(itertools.starmap(args[0], args[1]))
File "/data2/ruiran/seamless_interaction/src/seamless_interaction/fs.py", line 992, in _wget_download_from_s3
data = json.load(f)
File "/data2/ruiran/.conda/envs/seamlessinteraction/lib/python3.10/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/data2/ruiran/.conda/envs/seamlessinteraction/lib/python3.10/json/__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "/data2/ruiran/.conda/envs/seamlessinteraction/lib/python3.10/json/decoder.py", line 340, in decode
raise JSONDecodeError("Extra data", s, end)
json.decoder.JSONDecodeError: Extra data: line 2 column 1 (char 141)
"""
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/data2/ruiran/seamless_interaction/scripts/./download_s3.py", line 176, in
main()
File "/data2/ruiran/seamless_interaction/scripts/./download_s3.py", line 165, in main
download_single_example("V00_S0970_I00001220_P0602A") # Auto-samples if no file_id provided
File "/data2/ruiran/seamless_interaction/scripts/./download_s3.py", line 30, in download_single_example
fs.gather_file_id_data_from_s3(file_id)
File "/data2/ruiran/seamless_interaction/src/seamless_interaction/fs.py", line 740, in gather_file_id_data_from_s3
pool.starmap(
File "/data2/ruiran/.conda/envs/seamlessinteraction/lib/python3.10/multiprocessing/pool.py", line 375, in starmap
return self._map_async(func, iterable, starmapstar, chunksize).get()
File "/data2/ruiran/.conda/envs/seamlessinteraction/lib/python3.10/multiprocessing/pool.py", line 774, in get
raise self._value
json.decoder.JSONDecodeError: Extra data: line 2 column 1 (char 141)
```
How could this be solved? Thanks for your patience.
Contributor guide
Research direction
Reproduce the failure with download_single_example("V00_S0970_I00001220_P0602A") from scripts/download_s3.py, then read gather_file_id_data_from_s3 and _wget_download_from_s3 in src/seamless_interaction/fs.py around the reported lines 740 and 992. Compare the failing S3 responses with the working V01 example; done means the example downloads without the JSONDecodeError or reported SSL failures.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, python
- Domain
- cli, data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100