CFC-Servers / CFC-Servers/gmodwiki

[Feature] Easy category scraping

Open
#2 0 comments 0 reactions 1 assignee Claimed by @sarahsturgeon View on GitHub
enhancement
Dominant language
TypeScript
Stars
33
Forks
4
PR merge metrics
No merged PRs in 30d

Description

In other scrapers, they use a fancy `/page/preview` endpoint that lets them generate lists of all the pages in the category they want.
- [ref](https://github.com/NullEnt1ty/gmod-wiki-scraper/blob/master/src/wiki-api-client.ts#L28)
- [ref](https://github.com/NullEnt1ty/gmod-wiki-scraper/blob/master/src/wiki-scraper.ts#L178)

It would be nice if we could support this 1-1, though I worry because the `category` thing appears to be an internal property that isn't exposed on the frontend.

We can potentially query these ourselves during buildtime and store them - same thing with the tags.

Then, we just store the resulting .json in `public/` or upload to R2

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.