Add support for using `huggingface_hub.HfFileSystem` as a remote
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 15.9k
- Forks
- 1.3k
- PR merge metrics
- No merged PRs in 30d
Description
Assuming this would be fairly straightforward since it's already an fsspec compatible class. What all would be required? I'm happy to work on it. My guess is that there needs to be a new plugin dvc-hf, and an update to dvc-objects to add the scheme.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by examining how existing fsspec-compatible remotes are integrated, then assess the proposed dvc-hf plugin and dvc-objects scheme changes. Done means HfFileSystem can be used as a DVC remote through the supported workflow, with tests covering the new scheme.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface, python
- Domain
- data
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100