fsspec / fsspec/filesystem_spec
Suggestion: continue download
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 490
- Avg merge
- 2d 3h
- Merged PRs (30d)
- 38
Description
When downloading large files, it can commonly happen that the transfer aborts part way. Rather than having to restart the process, it would be nice to be able to read only the remaining bytes on a subsequent attempts. cat_file() already allows for providing a start byte (and end byte), but get_file() does not. I am proposing to both implement start/end byte and, more importantly, to allow "continue" whereby start=size-of-local-file.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the get_file() and cat_file() implementations and their existing tests. Compare the current start/end-byte behavior, then define coverage for resuming from a local file size; done means interrupted downloads can request only the remaining bytes without restarting.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api, backend
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100