JakeYallop / JakeYallop/WaybackDownloader

Store snapshot page progress and resume from a specific snapshot page

Open
#6 0 comments 0 reactions 0 assignees View on GitHub
help wanted
Dominant language
C#
Stars
12
Forks
1
PR merge metrics
No merged PRs in 30d

Description

Currently, pages of snapshots are re-downloaded each time, even though the pages included in those snapshots are already in the cache. We should be able to resume progress from a specific page of snapshots, rather than re-downloading as we do now.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing how snapshot pages are downloaded and how cached pages are checked. Define how progress for a specific snapshot page is stored and resumed; done means rerunning the utility skips already cached snapshot pages instead of downloading them again.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp
Domain
tooling
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.