BuilderIO / BuilderIO/micro-agent
Add request rate limiting for users on OpenAI `Usage tier 1`
Open
help wanted
- Dominant language
- TypeScript
- Stars
- 4.3k
- Forks
- 380
- PR merge metrics
- No merged PRs in 30d
Description
My current usage limits are pretty low (I'm not a prolific user of OpenAI API). I've not looked into the source code yet, but I suspect that micro-agent is sending more requests / using more tokens than the Usage tier 1 allows:
MODELTOKEN LIMITSREQUEST AND OTHER LIMITSBATCH QUEUE LIMITSgpt-4o
30,000 TPM
500 RPM
90,000 TPD
gpt-3.5-turbo60,000 TPM
500 RPM
10,000 RPD
200,000 TPD
gpt-410,000 TPM
500 RPM
10,000 RPD
100,000 TPD
gpt-4-turbo30,000 TPM
500 RPM
90,000 TPD
text-embedding-3-small1,000,000 TPM
3,000 RPM
3,000,000 TPD
dall-e-35 images per minute
tts-150 RPM
whisper-150 RPM
Contributor guide
Research direction
The issue names no files, tests, or entry points; start by locating where micro-agent sends OpenAI requests and uses tokens. Confirm the Usage tier 1 request and token limits and define how enforcement should work before choosing an implementation. Done means requests remain within the agreed limits, with tests covering the relevant behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- typescript
- Domain
- ai, api
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 28/100