Abraxas-365 / Abraxas-365/langchain-rust

Add Groq LLM integration (or ability to create custom LLM models)

未關閉
#239 2 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Rust
星號
1.3k
分支
177
PR 合併指標
30 天內沒有已合併 PR

描述

**Is your feature request related to a problem? Please describe.**
I have used the python Langchain library in a previous project for a Django backend. Now Im working on a new project that uses Tauri and its rust backend so naturally i was looking for implementation for Langchain in rust. In python I started using the [Groq chat model](https://python.langchain.com/api_reference/groq/chat_models/langchain_groq.chat_models.ChatGroq.html), I really liked its simple price model and fast inference so naturally i would want to use it in this project as well but currently there is no support for this.

**Describe the solution you'd like**
I would like an integration for the llm Groq model for langchain-rust like OpenAI,Claude and Ollama is supported. Currently there are some unnoffical sdk for Groq like [groq-api-rust](https://crates.io/crates/groq-api-rust) or [groq-rust](https://crates.io/crates/groq-rust)

**Describe alternatives you've considered**
The other alternative and more scalable solution for similar issues would be the ability to create a custom chat model similarly to how the python SDK works by wrapping the llm with the BaseChatModel.

https://python.langchain.com/docs/how_to/custom_chat_model/

貢獻指南

開啟貢獻指南

研究方向

Look at existing LLM integrations like OpenAI and Ollama in the langchain-rust codebase, likely in a directory like `langchain-rust/src/llm/`. Review the unofficial Groq Rust SDKs mentioned. Understand how to implement a new chat model struct that conforms to the library's traits. Check for any existing base model or trait definitions to extend. Test by building a minimal Groq client that can be integrated.

由索引模型根據 Issue 內容生成。

評估

技術堆疊
rust
領域
ai, backend
Issue 類型
功能
難度
4/5
預估耗時
3-5 天
活躍度
停滯
描述清晰度
基本清楚
新手友好度
45/100

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。