internetarchive / internetarchive/dweb-mirror

Related items calls being throttled

Open
#231 2 comments 0 reactions 0 assignees View on GitHub
2SC/ON Unrepeatable
Dominant language
JavaScript
Stars
330
Forks
34
PR merge metrics
No merged PRs in 30d

Description

When fetching related items during a crawl, its getting 429 (?) errors,
This is Gio's API throttling (reasonably) to protect the search.
I should throw these into a queue or otherwise reschedule them.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.