cloudfour / cloudfour/lighthouse-parade

Allow specific query parameters to be ignored

Open
#64 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
373
Forks
15
Avg merge
13h 36m
Merged PRs (30d)
34

Description

It would be nice to have the ability to disable (specific) query parameters to be counted as separate pages. For example we use query parameters to show analytics where the click comes from:

If the link was clicked in the footer of the page, the page url will be https://www.example.com/my-page?zone=footer
While if we click from the breadcrumb it would be https://www.example.com/my-page?zone=breadcrumb

But this means that the page would be picked up three times by the crawler, one time without query parameter, and two times with the zone query parameter. It would be nice to have a possibility to disable this because that would speed up the scan almost by three

Contributor guide

Open the contributing guide

Research direction

No file, test, or entry point is named. Start by tracing how the crawler discovers and compares URLs with query parameters, then identify the existing configuration path for controlling crawl behavior. Done means selected parameters no longer create separate crawled pages while other parameters continue to do so, with coverage for the example URLs.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
cli, performance
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.