AlibabaResearch / AlibabaResearch/DAMO-ConvAI
About reproducing the results on level 3 evaluation on API-Bank
Aperta
api-bank
- Lingua principale
- Python
- Stelle
- 1.6k
- Fork
- 250
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
Hi,
Thanks for sharing the excellent benchmark of API-bank! @liminghao1630
While I am trying to run the https://github.com/AlibabaResearch/DAMO-ConvAI/blob/main/api-bank/lv3_evaluator.py, it seems the prediction json file is missing.
Could you please help share json prediction file for reference?
Moreover, it will be really nice if you can provide some end-to-end evaluation file like https://github.com/AlibabaResearch/DAMO-ConvAI/blob/main/api-bank/evaluator.py for evaluation.
Regards
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Valutazione
Questa issue non è ancora stata valutata.