Correct prompt for Vicuna v1.5 7b in the case of RAG
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
Willing to use the Vicuna v1.5 7b model for RAG or Retrieval Augmented Generation (Q&A based on retrieved documents or context), I tried many prompts based on Llama 2 prompting but never managed to obtain a good answer following these criteria:
- Good formatting output (no prompt or context (retrieved documents) printing)
- The model has to answer 'I don't know' if the answer cannot be determined from the provided context
Does anyone has an advice for using Vicuna v1.5 7b for RAG?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are mentioned. Begin by reproducing the reported Vicuna v1.5 7b RAG behavior with the prompts under discussion. Done would require a validated recommendation that meets both stated output criteria.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, machine-learning
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100