AlibabaResearch / AlibabaResearch/DAMO-ConvAI
Evaluation Method for BIRD Dataset [Enhancement]
未关闭
- 主要语言
- Python
- 星标
- 1.6k
- 派生
- 250
- PR 合并指标
- 30 天内没有已合并 PR
描述
Hello,
I encountered an improvement opportunity during the evaluation process for the BIRD dataset. The prediction below is marked as incorrect by the evaluation method, but the only difference is the order of the elements.
The evaluation method uses strict equality. This occurs in the file [bird/llm/src/evaluation.py](https://github.com/AlibabaResearch/DAMO-ConvAI/blob/main/bird/llm/src/evaluation.py) on line 26.
贡献指南
这个仓库没有索引到贡献指南
评估
这个 Issue 还没有评估数据。