How can we restrict Vicuna, so it can generate the text in expected format that i want?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
Hi @infwinston @Mearman @zhisbug @jegonzal @Shawnlu25
I'm trying to generate meeting minutes using vicuna-13b, using a chunk from my meeting transcript (due to context size restrictions I'm creating chunks of the meeting transcripts and passing one by one.) Here is the expected format i want and it is generated by the vicuna ..
```
Topics Discussed:
* Language Model and Meeting Summary Generation
* Input and Output Sizes of Language Model
* Fine-Tuning Data Sets
* Average Size of Meeting Minutes
Meeting Summary:
XX and YY discussed the Language Model and Meeting Summary Generation. XX asked YY to explain the input and output sizes of the Language Model and the reason for restricting the output to 200 tokens.
Action Points:
1. XX will show Alankar the current size of the minutes that have been generated.
2. YY will generate a summary for the internal team meetings that were attended by Sarma.
```
But this behaviour changes when i'm passing next chunk of the transcript and so on...
1. Is it possible to restrict vicuna to generate the minutes only this way?
2. Can finetuning help?
3. Max context len is 2048 (it is like gp3? like in gpt 3 the context length is 4096 which is prompt + output) , if you can clarify that will be great.
Any help would be great.. thanks!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points. Start by clarifying whether the requested outcome is prompt-format enforcement, fine-tuning guidance, or context-length documentation; the work is done when the supported approach and its context-limit behavior are clearly documented or implemented.
Written by the indexing model from the issue text.
Assessment
- Domain
- ai, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100