RSSNext / RSSNext/Folo

Automatic Removal of Duplicate Titles/Content

Open
#780 9 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement server
Dominant language
TypeScript
Stars
39k
Forks
2.1k
Avg merge
1d 4h
Merged PRs (30d)
10

Description

Clear and concise description of the problem

When subscribing to multiple feeds, it's crucial to ensure that exclusive content isn't missed while also preventing the overload of duplicate articles. Implementing a feature to eliminate duplicates would effectively address this concern.

  1. Provide multiple methods to detect duplicate articles:
  • Identical URL
  • Identical title
  • Almost identical title
  1. Allow users to set the comparison period (settings can be adjusted for 6 hours, 12 hours, 1 day to 30 days).
  2. Offer an optional toggle feature, allowing users to decide whether to enable the automatic deduplication function.
Suggested solution

👇example

Image
Image
Image

Alternative

No response

Additional context

No response

Validations
  • Check that there isn't already an issue that request the same feature to avoid creating a duplicate.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are named in the issue, so first map the feed subscription, article comparison, and settings areas of the TypeScript application. Treat the listed URL, title, near-title, comparison-period, and opt-in requirements as the acceptance criteria, then confirm the relevant behavior through the project's existing tests or user interface.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
full-stack
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.