tensorflow / tensorflow/datasets
CroissantBuilder does not work on Windows machines
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.6k
- Forks
- 1.6k
- Avg merge
- 3h 54m
- Merged PRs (30d)
- 1
Description
Short description
When using a simple example code snippet of the CroissantBuilder to load datasets using the croissant format, it only seems to work on Linux.
The code snippet below correctly downloads and prepares a dataset on Collab, or WSL, but results in an error on Windows. All tested on a clean virtual environment.
Environment information
-
Operating System: Windows 11
-
Python version: 3.11.1
-
tensorflow-datasets/tfds-nightlyversion: tfds-nightly 4.9.6.dev202408050044 -
tensorflow/tf-nightlyversion: tensorflow 2.17.0 -
Does the issue still exists with the last
tfds-nightlypackage (pip install --upgrade tfds-nightly) ?
Yes
Reproduction instructions
import mlcroissant as mlc
import tensorflow_datasets as tfds
url = "https://huggingface.co/api/datasets/fashion_mnist/croissant"
builder = tfds.core.dataset_builders.CroissantBuilder(jsonld=url, file_format='array_record')
builder.download_and_prepare()
Link to logs
https://pastebin.com/fRrfn8jj
Expected behavior
A dataset builder is prepared such that I can use .as_data_source() later.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.