fsspec / fsspec/filesystem_spec
Feature Request: Copy between filesystems
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 490
- Avg merge
- 2d 3h
- Merged PRs (30d)
- 38
Description
It would be great if we could copy between two different remote filesystems with fsspec.
I think this can be achieved with minimal effort if we check if the lpath is a path in a known filesystem in get/put_file functions in fsspec.spec. Then we could just use lpath.fs.open() instead of open(lpath).
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start in fsspec/spec.py at the get and put_file functions around the referenced lines, and read how lpath and known filesystems are represented. Verify the current behavior for paths belonging to another remote filesystem. Done means copying between two different remote filesystems works through the appropriate filesystem path handling, with relevant tests updated or added if the existing test structure covers these functions.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100