google / google/array_record

GCS support

Open
#120 3 comments 1 reaction 0 assignees View on GitHub
Dominant language
C++
Stars
142
Forks
26
PR merge metrics
No merged PRs in 30d

Description

While trying to load a TFDS dataset from GCS, I encountered this error:
```
/usr/local/lib/python3.10/dist-packages/array_record/python/array_record_data_source.py in _create_reader
176 def _create_reader(filename: epath.PathLike):
177 """Returns an ArrayRecordReader for the given filename."""
--> 178 return array_record_module.ArrayRecordReader(
179 filename,
180 options="readahead_buffer_size:0",

RuntimeError: open() failed: No such file or directory; opening gs://ref_coco/ref_coco/refcoco_unc/1.1.0/ref_coco-train.array_record-00000-of-00032
```
See the minimum reproducible example here:

https://colab.research.google.com/drive/1iezVDZBJrWtP3fVTpAMNGb6qfENZNKuD?usp=sharing

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.