sitespeedio / sitespeedio/sitespeed.io

I want to crawl a custom sitemap.xml or CSV file

Open
#4,057 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
JavaScript
Stars
5k
Forks
624
Avg merge
4h 8m
Merged PRs (30d)
2

Description

Feature/improvement

Is it possible to evaluate a list of URLs from either a custom sitemap.xml or CSV file.

Crawling is great, but there are times you want to actually be able to compare the same URLs you evaluated 6 months ago, with what you have now.

I know this is possible in Unlighthouse, and am a bit surprised it isn't in the documentation. I can't find it in the code either.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the existing crawling input handling and documentation for sitemap or URL-list support. Define how a custom sitemap.xml or CSV file would be supplied, then verify that the same URLs can be evaluated again for comparison with a prior run.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
cli, web-dev
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.