Possible incorrect data reporting
Open
Nobody has claimed this yet.
- Dominant language
- TypeScript
- Stars
- 132
- Forks
- 17
- PR merge metrics
- No merged PRs in 30d
Description
System Tested:
- CPU: AMD Ryzen 7700
- GPU: AMD Radeon 6950 XT (Watercooled, max GPU temp 55C)
- RAM: 64 GB
- OS: Win 11 all updates (as of 10/19/2025)
Test results:
- Test 1681 (Llama 3.1 8B): Score=160, Gen=6.13, Prompt=1016, TTFT=1520
- Test 1671 (Qwen2.5 14B): Scoore=86,Gen=3.3,Prompt=569,TTFT=2850
When compared to other comparable cards (Radeon 6800, Radeon 6900 XT, Radeon 7800 XT), the results align. 2 cards that are not as strong scored significantly higher in all elements/scores of the test.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing tests 1681 and 1671 on the listed Ryzen 7700 and Radeon 6950 XT setup, then compare the results with the referenced Radeon cards. Done means determining whether the reported scores are incorrect and documenting the evidence or identifying the source of the discrepancy.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- typescript
- Domain
- machine-learning, performance, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100