open-compass / open-compass/opencompass
[documentation] 希望增加一个完整链路级别的文档指导如何测评一个指定模型
Open
@gaotongxiao is already working on this.
Since Jul 19, 2023.
backlog
Enhancement
- Dominant language
- Python
- Stars
- 7.5k
- Forks
- 869
- Avg merge
- 17h 52m
- Merged PRs (30d)
- 13
Description
描述该错误
https://opencompass.readthedocs.io/en/latest/advanced_guides/new_model.html
这个文档中已经有关于如何新增model支持的描述，但是对于如何完成评测一个新增model，这部分文档还比较分散，比如需要：
- 新增model类的几个方法的实现（以api为例）
- 新增对应config
希望文档能有一个整体性的描述，对小白用户比较友好
环境信息
无
其他信息
No response
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.