CFC-Servers / CFC-Servers/gmodwiki

[Epic] Scraping Features

Open
#3 0 comments 0 reactions 1 assignee Claimed by @sarahsturgeon View on GitHub
enhancement
Dominant language
TypeScript
Stars
33
Forks
4
PR merge metrics
No merged PRs in 30d

Description

I want people to be able to scrape the mirror super easily, even if the main site is down or whatever.

Ideally, we could serve a number of different json files:
- [One for each tag](https://github.com/CFC-Servers/gmodwiki/issues/1)
- [One for each category](https://github.com/CFC-Servers/gmodwiki/issues/2)
- One for all pages

And then allow people to query multiple at a time.

For self hosting, this will inflate the total image size by quite a bit.. maybe 100+mb which could nearly double the final size. Maybe we can exclude this from self hosted?

For the live site, it should be fine - it'll just be a number of R2 reads, which are super cheap and cache-able.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.