hydrusnetwork / hydrusnetwork/hydrus
Setting for parsers to skip files based on time since upload
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 3.2k
- Forks
- 207
- PR merge metrics
- No merged PRs in 30d
Description
Parser setting that skips newly uploaded posts based on parsed time/date.
Thought process is that it will WAIT with the parsing and downloading of the post untill a certain time from current time.
That way you dont grab posts that has a single tag or very few tags.
This makes sense for subs for example and other things.
Guess it would keep the post in the queue and just apply a skip to it when it sees the time past since post is too small/early.
Not parsing and processing posts that is say younger than 12h makes sense i think?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points. Start by locating parser settings and the post queue, then clarify whether young posts should wait, be skipped, or be revisited after the configured age. Done should include an agreed setting, queue behavior, and tests for posts before and after the time threshold.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100