AnswerDotAI / AnswerDotAI/rerankers

API rate limiting

Open
#33 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.6k
Forks
104
PR merge metrics
No merged PRs in 30d

Description

This could be added to the api models by interpreting response headers or maybe an option given to Reranker which limits the amount of requests per min.

For instance, Jina when not on premium is 60 rpm. Cohere is 10 rpm on trial key and 1000 rpm on production key

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.