0xPlaygrounds / 0xPlaygrounds/rig
feat: Add unified batch processing API
- Vorherrschende Sprache
- Rust
- Sterne
- 8.6k
- Forks
- 959
- Ø Merge
- 4 Std. 32 Min.
- Gemergte PRs (30 T.)
- 117
Beschreibung
- [x] I have looked for existing issues (including closed) about this
## Feature Request
e.g. https://platform.claude.com/docs/en/build-with-claude/batch-processing
https://ai.google.dev/gemini-api/docs/batch-api
https://platform.openai.com/docs/guides/batch
### Motivation
To send asynchronous groups of requests with 50% lower costs, a separate pool of significantly higher rate limits, and a clear 24-hour turnaround time. The service is ideal for processing jobs that don't require immediate responses.
### Proposal
Not as of now. I saw there is already JSONL decoder here so might be a starting point https://github.com/0xPlaygrounds/rig/blob/a9be75857e8b90cb24cefa0f509a5af48e90da97/rig/rig-core/src/providers/anthropic/decoders/jsonl.rs#L1
### Alternatives
No
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.