AIAnytime / AIAnytime/RAG-Tool-using-Haystack-Mistral-and-Chainlit

Local?

Open
#2 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
23
Forks
12
PR merge metrics
No merged PRs in 30d

Description

Hey good work.

I need this to run locally. It looks like it's using the hugging face api.

```
HF_TOKEN = os.environ.get("HF_TOKEN")

prompt_node = PromptNode(
model_name_or_path="mistralai/Mistral-7B-Instruct-v0.1", api_key=HF_TOKEN, default_prompt_template=prompt_template
)
```

Will try to get it running locally but I think there is a haystack class needed for this.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.