deepseek-ai / deepseek-ai/DeepSeek-Coder
Evaluate on APPS
Open
- Dominant language
- Python
- Stars
- 24.3k
- Forks
- 2.9k
- PR merge metrics
- No merged PRs in 30d
Description
Thx for your nice work!
As you mentioned [here](https://github.com/deepseek-ai/deepseek-coder?tab=readme-ov-file#1-introduction-of-deepseek-coder) that deepseek-coder models show SOTA performance on APPS, while you might not report the exact scores or the code for evaluation on APPS benchmark. Will you share the evaluation scripts for APPS?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.