SSWConsulting / SSWConsulting/SSW.Website
🔍V1 site - pages being ignored by robots.txt
Nobody has claimed this yet.
- Dominant language
- HTML
- Stars
- 14
- Forks
- 10
- Avg merge
- 13h 51m
- Merged PRs (30d)
- 38
Description
CC: @PennyWalker, @wicksipedia
There are a few v1 pages that appear in our robots.txt file that were ported as part of the archive project. This isn't isn't ideal because the point of the archiving the page is that we wouldn't use the links.
The following routes have been excluded:
- /ssw/LinkAuditor
- /ssw/CodeAuditor
- /ssw/Version.aspx
- /ssw/Redirect (not in the archive repo, leave in robots.txt)
- [ ] find the robots.txt file that references these files
- [ ] remove them from the robots.txt file
Figure: v1 files excluded in the robots.txt file
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the robots.txt file that references /ssw/LinkAuditor, /ssw/CodeAuditor, and /ssw/Version.aspx. Remove those three routes while leaving /ssw/Redirect in robots.txt because it is not in the archive repository. Done means the archived routes are no longer excluded by robots.txt.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- nextjs
- Domain
- web-dev
- Issue type
- Bug
- Difficulty
- 1/5
- Estimated time
- Under an hour
- Activity status
- Stale
- Clarity
- Clearly specified
- Newbie friendliness
- 55/100