cloudfour / cloudfour/lighthouse-parade

Error fetching (404) for a lot of unexisting urls

Open
#131 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
373
Forks
15
Avg merge
13h 36m
Merged PRs (30d)
34

Description

Hello !

Today, I tried to lighthouse parade this website : [https://monsieurcocorico.com/](https://monsieurcocorico.com/)
The crawler found a lot of urls that doesn't exist on the website and the script keep trying to fetch them.

image

Maybe a wordpress plugin is disturbing the script...
Does someone have already encounter this problem ?

Contributor guide

Open the contributing guide

Research direction

Reproduce the crawl against https://monsieurcocorico.com/ and inspect the crawler's URL-fetching behavior. The issue names no files or tests, so first locate the code that queues and fetches discovered URLs. Done means the cause of the repeated requests to nonexistent URLs is identified and the crawler handles them appropriately.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
cli
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.