seo: add robots.txt with sitemap reference
Nobody has claimed this yet.
- Dominant language
- TypeScript
- Stars
- 7
- Forks
- 1
- Avg merge
- 1h 41m
- Merged PRs (30d)
- 21
Description
Problem
public/robots.txt doesn't exist. Only an in-page <meta name="robots" content="index, follow"> tag exists in index.html. Crawlers look for /robots.txt first to discover crawl rules and the sitemap location before rendering any JS.
Task
Add public/robots.txt:
User-agent: *
Allow: /
Sitemap: https://coding.mazipan.space/sitemap.xml
Depends on the sitemap existing at that path (see the sitemap.xml sub-issue) — either land together or add the Sitemap: line in a follow-up commit once that file exists.
Files
public/robots.txt(new)
Part of
#74
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the issue’s specified new file, public/robots.txt, and compare it with the existing sitemap path and the robots meta tag in index.html. Add the requested crawler rules and sitemap reference, confirming that the sitemap dependency is available or coordinating the follow-up noted in the issue. Done means public/robots.txt exists with the specified contents.
Written by the indexing model from the issue text.
Assessment
- Domain
- web-dev
- Issue type
- Feature
- Difficulty
- 1/5
- Estimated time
- Under an hour
- Activity status
- Active
- Clarity
- Clearly specified
- Newbie friendliness
- 88/100