DAMO-NLP-SG / DAMO-NLP-SG/LLM-R2
Seeing duplicate demos
- Dominant language
- Python
- Stars
- 54
- Forks
- 13
- PR merge metrics
- No merged PRs in 30d
Description
I noticed in a query I was optimizing, when using using `num_promos = 3`, I was getting duplicate demonstrations. I am not sure if that's because there are duplicates in the selection pool or something else. As a quick fix, I did change
`sorted_scores = sorted(sim_scores, reverse=True)`
to
`sorted_scores = list(set(sorted(sim_scores, reverse=True)))`
in `get_k_promos` in LLM_R2.py.
This worked, but I'm guessing there is a better fix. Of course I'm operating under the assumption that you didn't intend to produce duplicate demos inside the prompt.
Please advise. Again, I am continually thankful for your work and responses to my questions.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.