google/robotstxt
View on GitHubThe repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
- Stars
- 3.5k
- Forks
- 255
- Open beginner issues
- 0
- Indexed issues
- 10
- Dominant language
- C++
- License
- Apache-2.0
- Last GitHub push
- Apr 1, 2026
- Latest indexed
- Sep 16, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- Code of conduct
- Beginner labels
- No beginner labels indexed
- PR merge metrics
- No merged PRs in 30d
-
google/robotstxt#27 · 1 comment · 0 reactions · 0 assignees ·
-
Library ported to Go Open
google/robotstxt#29 · 4 comments · 3 reactions · 0 assignees ·
-
google/robotstxt#31 · 2 comments · 6 reactions · 0 assignees ·
-
google/robotstxt#42 · 2 comments · 1 reaction · 0 assignees ·
-
google/robotstxt#57 · 0 comments · 0 reactions · 0 assignees ·
-
google/robotstxt#58 · 3 comments · 0 reactions · 0 assignees ·
-
google/robotstxt#60 · 6 comments · 2 reactions · 0 assignees ·
-
google/robotstxt#64 · 0 comments · 0 reactions · 0 assignees ·
-
google/robotstxt#85 · 1 comment · 0 reactions · 0 assignees ·
-
google/robotstxt#87 · 0 comments · 0 reactions · 0 assignees ·