ByteDance-Seed / ByteDance-Seed/Seed-Coder

Seed-Coder-8B-Instruct,在几个评测集上效果很差。。。

Open
#16 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
759
Forks
59
PR merge metrics
No merged PRs in 30d

Description

hello,感谢开源模型,我在几个公开的评测集上进行自评测,保证采用每个benchmark官方的评测框架,发现效果一般,是模型的某些参数导致的吗(例如温度,一般的benchmark默认采用0.0),这是我评测的结果:

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.