MaartenGr / MaartenGr/BERTopic
Llama 2: Representation Model
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 7.8k
- Forks
- 920
- Avg merge
- 22h 24m
- Merged PRs (30d)
- 5
Description
In the documentation, it mentioned that:
_By default, four of the most representative documents will be passed to [DOCUMENTS]. These documents are selected by calculating their similarity (through c-TF-IDF representations) with the main c-TF-IDF representation of the topics. The four best matching documents per topic are selected.
To increase the number of documents passed to [DOCUMENTS], we can use the nr_docs parameter which is accessible in all LLMs on this page._
I am using Llama 2 to represent a label for each cluster. but I don't want to pass only the four of the most representative documents; I want to pass the top 10 or 20 or maybe all the documents.
I try to use the **nr_docs** parameter, but when I check the number of the representative documents, it displays 3.
llama2 = TextGeneration(generator, nr_docs= 20, prompt=prompt)
How can we ensure that Llama 2 provides an accurate and appropriate name if we don't have all of the cluster's documents?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the Llama 2 TextGeneration example with nr_docs=20 and inspect how the representative-document count is determined. Confirm whether the parameter is honored, then update the behavior or documentation so the resulting document count and supported limits are clear.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100