mozilla / mozilla/probe-scraper
Deal with trailing slashes in the `url` property of `repositories.yaml` entries
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 26
- Forks
- 73
- Avg merge
- 10h
- Merged PRs (30d)
- 3
Description
We have been bitten by trailing slashes in the url property of repositories.yaml entries in the past, always resulting in broken probe-scraper runs, with #458 being its last instance.
We should probably add some resilience to this logic within the probe-scraper, to either check and forbid trailing slashes in the url property or gracefully handle them at runtime.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing how the probe-scraper reads the url property from repositories.yaml, using the trailing-slash failure in #458 as context. Define done as trailing slashes being either clearly rejected during validation or handled without breaking probe-scraper runs, with behavior checked against the affected workflow.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100