open-compass / open-compass/opencompass
[Bug] lark报告时,base,py L66会有bug
@Leymore is already working on this.
Since Nov 15, 2023.
- Dominant language
- Python
- Stars
- 7.5k
- Forks
- 869
- Avg merge
- 17h 52m
- Merged PRs (30d)
- 13
Description
先决条件
问题类型
我正在使用官方支持的任务/模型/数据集进行评估。
环境
重现问题 - 代码/配置示例
重现问题 - 命令或脚本
重现问题 - 错误信息
Traceback (most recent call last):
File "/alg_vepfs/private/zhaoyu/opencompass/run.py", line 346, in
main()
File "/alg_vepfs/private/zhaoyu/opencompass/run.py", line 298, in main
runner(tasks)
File "/alg_vepfs/private/zhaoyu/opencompass/opencompass/runners/base.py", line 39, in call
self.summarize(status)
File "/alg_vepfs/private/zhaoyu/opencompass/opencompass/runners/base.py", line 66, in summarize
num_succeeded = len(status) - len(failed_logs)
TypeError: object of type 'generator' has no len()
其他信息
最后的这个status是预期外的值,并不是
status (list[tuple[str, int]]): A list of (task name, exit code).
需要注释掉后,可以正常运行
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.