0xPlaygrounds / 0xPlaygrounds/rig

feat: Add unified batch processing API

Offen
#1,244 6 Kommentare 1 Reaktion 0 zugewiesene Personen Auf GitHub ansehen
accepted feat
Vorherrschende Sprache
Rust
Sterne
8.6k
Forks
959
Ø Merge
4 Std. 32 Min.
Gemergte PRs (30 T.)
117

Beschreibung

- [x] I have looked for existing issues (including closed) about this

## Feature Request
e.g. https://platform.claude.com/docs/en/build-with-claude/batch-processing
https://ai.google.dev/gemini-api/docs/batch-api
https://platform.openai.com/docs/guides/batch

### Motivation
To send asynchronous groups of requests with 50% lower costs, a separate pool of significantly higher rate limits, and a clear 24-hour turnaround time. The service is ideal for processing jobs that don't require immediate responses.

### Proposal
Not as of now. I saw there is already JSONL decoder here so might be a starting point https://github.com/0xPlaygrounds/rig/blob/a9be75857e8b90cb24cefa0f509a5af48e90da97/rig/rig-core/src/providers/anthropic/decoders/jsonl.rs#L1

### Alternatives
No

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.