JuliaML / JuliaML/MLDatasets.jl

[Discussion] Moving to HuggingFace for some databases

Open
#242 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Julia
Stars
239
Forks
51
PR merge metrics
No merged PRs in 30d

Description

Some of the (graph) databases that we are trying to support might have either of the following problems:
1. Hosted in university servers or a non-trusted source which cannot provide proper download speeds though out the globe.
2. Datasets that aren't hosted anywhere and come with a license
3. Datasets stored as python formats.

HuggingFace has now good set of community maintained [graph datasets](https://huggingface.co/graphs-datasets). If we come across any of these above issues for a dataset, we can try to add these datasets to HF and then pull from HF and then process as required. This I believe will largely reduce code for integrating and testing new datasets. I am not sure about the planned support for https://github.com/FluxML/HuggingFaceApi.jl but this seems to me like a better idea than relying on links that can fail without warning.

cc: @CarloLucibello

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.