AlibabaResearch / AlibabaResearch/DAMO-ConvAI
About reproducing the results on level 3 evaluation on API-Bank
Abierto
api-bank
- Lenguaje dominante
- Python
- Estrellas
- 1.6k
- Forks
- 250
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
Hi,
Thanks for sharing the excellent benchmark of API-bank! @liminghao1630
While I am trying to run the https://github.com/AlibabaResearch/DAMO-ConvAI/blob/main/api-bank/lv3_evaluator.py, it seems the prediction json file is missing.
Could you please help share json prediction file for reference?
Moreover, it will be really nice if you can provide some end-to-end evaluation file like https://github.com/AlibabaResearch/DAMO-ConvAI/blob/main/api-bank/evaluator.py for evaluation.
Regards
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Evaluación
Este issue todavía no se ha evaluado.