aai-institute / aai-institute/lakefs-spec

TensorFlow and LakeFS

Đang mở
#257 6 bình luận 0 reaction 0 người được giao Xem trên GitHub
triage
Ngôn ngữ chính
Python
Star
65
Fork
7
Chỉ số merge pull request
Không có pull request nào được merge trong 30 ngày

Mô tả

### What is the motivation and/or use case?

This is a very nice tutorial in how to use Pandas and LakeFS integrated [LakeFS File System](https://lakefs.io/blog/lakefs-spec/) integrated to read a *.csv file directly from repository. This is very useful.

I am looking for something similar to work with TensorFlow and images particularly. I checked and seems to me that there is nothing implemented for this so far. [TensorFlow IO](https://pypi.org/project/tensorflow-io/)

This might be something very interesting to have, once that LakeFS works well with huge datasets. We can benefit from this "connection" and avoid downloading everything to a local/cloud machine to train models.

### How can we implement this feature?

Ideally a [plugin](https://www.w3cschool.cn/doc_tensorflow_guide/tensorflow_guide-extend-add_filesys.html) for TensorFlow would be awesome or an addition to the [LakeFS-spec](https://lakefs-spec.org/latest/). Thanks for all the good work so far!

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.