aai-institute / aai-institute/lakefs-spec

TensorFlow and LakeFS

Offen
#257 6 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
triage
Vorherrschende Sprache
Python
Sterne
65
Forks
7
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

### What is the motivation and/or use case?

This is a very nice tutorial in how to use Pandas and LakeFS integrated [LakeFS File System](https://lakefs.io/blog/lakefs-spec/) integrated to read a *.csv file directly from repository. This is very useful.

I am looking for something similar to work with TensorFlow and images particularly. I checked and seems to me that there is nothing implemented for this so far. [TensorFlow IO](https://pypi.org/project/tensorflow-io/)

This might be something very interesting to have, once that LakeFS works well with huge datasets. We can benefit from this "connection" and avoid downloading everything to a local/cloud machine to train models.

### How can we implement this feature?

Ideally a [plugin](https://www.w3cschool.cn/doc_tensorflow_guide/tensorflow_guide-extend-add_filesys.html) for TensorFlow would be awesome or an addition to the [LakeFS-spec](https://lakefs-spec.org/latest/). Thanks for all the good work so far!

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.