How to find voting result and create plot?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
Hello,
Thanks for this wonderful project.
I would like to create personal local LLM voting system with current open source LLMs such as llama3.1, gemma2.
1. there is a problem when I run some recent LLM such as gemma. it returns network error, but everything is right. Other have also reported this issue, but I couldn't figure out how to solve it.
2. How could I get the voting result? I believe the voting result should be saved somewhere in like json, but I couldn't point out where it is. Also, with the result, I would like to visualize the plot such as confusing matrix between models, etc.
could someone point out the process?
(how to find the result, then visualization process?)
Thank you!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by tracing the local voting flow to find where results are written, then reproduce the reported Gemma network error; done means documenting the result location, visualization process, and the cause or workaround for that error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, data-visualization
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100