Abraxas-365 / Abraxas-365/langchain-rust
Use batch requests for embeddings for Ollama
- 主要语言
- Rust
- 星标
- 1.3k
- 派生
- 177
- PR 合并指标
- 30 天内没有已合并 PR
描述
Currently Ollama loops and manually calls embedding endpoint one at a time.
Ollama has added native support for batch embeddings. https://github.com/ollama/ollama/pull/5127
Update langchain-rust to directly use batch embeddings api when ollama-rs supports it. https://github.com/pepperoni21/ollama-rs/issues/58
贡献指南
调研方向
Find the Ollama embedding calls in the codebase, likely in a module handling Ollama integration. Wait for ollama-rs to support batch embeddings (track issue #58). Then update the code to replace sequential calls with a batch request, ensuring the API change is compatible. Test with the existing embedding tests to verify functionality and performance improvement.
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- ollama, rust
- 领域
- ai-infra-agents
- Issue 类型
- 功能
- 难度
- 3/5
- 预计耗时
- 1-2 天
- 活跃度
- 停滞
- 描述清晰度
- 描述清楚
- 新手友好度
- 45/100