Cannot download annotations

### Have you read the Contributing Guidelines?

- [x] I have read the [Contributing Guidelines](https://github.com/facebookresearch/seamless_interaction/blob/main/CONTRIBUTING.md).

### Issue Type

Missing files or data

### Dataset Label

improvised

### Dataset Split

train

### Affected Files/Data and Issue Description

I am not able to download the annotations for any of the splits/batches. Is this supposed to happen and/or a known issue? If so, is there a way to access the annotations?

### Steps to Reproduce

Run any of the download_hf/s3 scripts.

### Additional Context

_No response_

### Self-service

- [x] I'd be willing to help investigate this data issue. Add comment

Start by running the download_hf or s3 scripts mentioned in the issue and compare whether annotations are unavailable for every split or batch. Check the relevant download output and determine whether the missing annotations can be accessed; done means the access problem is resolved or its availability is clearly documented.

Written by the indexing model from the issue text.