AlibabaResearch / AlibabaResearch/DAMO-ConvAI
About reproducing the results on level 3 evaluation on API-Bank
Open
api-bank
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 250
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
Thanks for sharing the excellent benchmark of API-bank! @liminghao1630
While I am trying to run the https://github.com/AlibabaResearch/DAMO-ConvAI/blob/main/api-bank/lv3_evaluator.py, it seems the prediction json file is missing.
Could you please help share json prediction file for reference?
Moreover, it will be really nice if you can provide some end-to-end evaluation file like https://github.com/AlibabaResearch/DAMO-ConvAI/blob/main/api-bank/evaluator.py for evaluation.
Regards
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.