AlibabaResearch / AlibabaResearch/DAMO-ConvAI
About reproducing the results on level 3 evaluation on API-Bank
Ouverte
api-bank
- Langage dominant
- Python
- Étoiles
- 1.6k
- Forks
- 250
- Métriques de merge des PR
- Aucune PR mergée en 30 j
Description
Hi,
Thanks for sharing the excellent benchmark of API-bank! @liminghao1630
While I am trying to run the https://github.com/AlibabaResearch/DAMO-ConvAI/blob/main/api-bank/lv3_evaluator.py, it seems the prediction json file is missing.
Could you please help share json prediction file for reference?
Moreover, it will be really nice if you can provide some end-to-end evaluation file like https://github.com/AlibabaResearch/DAMO-ConvAI/blob/main/api-bank/evaluator.py for evaluation.
Regards
Guide de contribution
Aucun guide de contribution indexé pour ce dépôt
Évaluation
Cette issue n'a pas encore été évaluée.