open-compass / open-compass/opencompass

[Bug] lark报告时,base,py L66会有bug

Open
#588 0 comments 0 reactions 2 assignees View on GitHub

@Leymore is already working on this.

Since Nov 15, 2023.

Dominant language
Python
Stars
7.5k
Forks
869
Avg merge
17h 52m
Merged PRs (30d)
13

Description

先决条件
问题类型

我正在使用官方支持的任务/模型/数据集进行评估。

环境
重现问题 - 代码/配置示例
重现问题 - 命令或脚本
重现问题 - 错误信息

Traceback (most recent call last):
File "/alg_vepfs/private/zhaoyu/opencompass/run.py", line 346, in
main()
File "/alg_vepfs/private/zhaoyu/opencompass/run.py", line 298, in main
runner(tasks)
File "/alg_vepfs/private/zhaoyu/opencompass/opencompass/runners/base.py", line 39, in call
self.summarize(status)
File "/alg_vepfs/private/zhaoyu/opencompass/opencompass/runners/base.py", line 66, in summarize
num_succeeded = len(status) - len(failed_logs)
TypeError: object of type 'generator' has no len()

其他信息

最后的这个status是预期外的值,并不是

status (list[tuple[str, int]]): A list of (task name, exit code).
image image

需要注释掉后,可以正常运行

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.