Abraxas-365 / Abraxas-365/langchain-rust
Use batch requests for embeddings for Ollama
Aperta
- Lingua principale
- Rust
- Stelle
- 1.3k
- Fork
- 177
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
Currently Ollama loops and manually calls embedding endpoint one at a time.
Ollama has added native support for batch embeddings. https://github.com/ollama/ollama/pull/5127
Update langchain-rust to directly use batch embeddings api when ollama-rs supports it. https://github.com/pepperoni21/ollama-rs/issues/58
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.