JakeYallop / JakeYallop/WaybackDownloader
Store snapshot page progress and resume from a specific snapshot page
Open
help wanted
- Dominant language
- C#
- Stars
- 12
- Forks
- 1
- PR merge metrics
- No merged PRs in 30d
Description
Currently, pages of snapshots are re-downloaded each time, even though the pages included in those snapshots are already in the cache. We should be able to resume progress from a specific page of snapshots, rather than re-downloading as we do now.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing how snapshot pages are downloaded and how cached pages are checked. Define how progress for a specific snapshot page is stored and resumed; done means rerunning the utility skips already cached snapshot pages instead of downloading them again.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- csharp
- Domain
- tooling
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100