Abraxas-365 / Abraxas-365/langchain-rust
Add Groq LLM integration (or ability to create custom LLM models)
- Ngôn ngữ chính
- Rust
- Star
- 1.3k
- Fork
- 177
- Chỉ số merge pull request
- Không có pull request nào được merge trong 30 ngày
Mô tả
**Is your feature request related to a problem? Please describe.**
I have used the python Langchain library in a previous project for a Django backend. Now Im working on a new project that uses Tauri and its rust backend so naturally i was looking for implementation for Langchain in rust. In python I started using the [Groq chat model](https://python.langchain.com/api_reference/groq/chat_models/langchain_groq.chat_models.ChatGroq.html), I really liked its simple price model and fast inference so naturally i would want to use it in this project as well but currently there is no support for this.
**Describe the solution you'd like**
I would like an integration for the llm Groq model for langchain-rust like OpenAI,Claude and Ollama is supported. Currently there are some unnoffical sdk for Groq like [groq-api-rust](https://crates.io/crates/groq-api-rust) or [groq-rust](https://crates.io/crates/groq-rust)
**Describe alternatives you've considered**
The other alternative and more scalable solution for similar issues would be the ability to create a custom chat model similarly to how the python SDK works by wrapping the llm with the BaseChatModel.
https://python.langchain.com/docs/how_to/custom_chat_model/
Hướng dẫn đóng góp
Đánh giá
Issue này chưa được đánh giá.