deepseek-ai / deepseek-ai/DeepSeek-Math
Unable to get evaluation results
Open
- Dominant language
- Python
- Stars
- 3.4k
- Forks
- 592
- PR merge metrics
- No merged PRs in 30d
Description
I've followed the steps given in the evaluation readme and run the inference file
However, I don't get any results :/
The results.json file has all blank entries with n_samples=0 always
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the evaluation README and the inference file referenced in the issue. Reproduce the run and inspect why results.json contains blank entries with n_samples=0; done means the evaluation produces populated results or the input/configuration problem is clearly documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100