AlibabaResearch / AlibabaResearch/DAMO-ConvAI

Graphix inference code for Spider test set and dev/test of variants of Spider (DK, SYN, Realistic)

Open
#144 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.6k
Forks
250
PR merge metrics
No merged PRs in 30d

Description

Hi there,

I've been trying to replicate the performance of the `graphix-3b + picard` model on the Spider test set, but I noticed that there doesn't seem to be an existing script for this. Could anyone please share the script/code-snippet used to do so?

Also, in order to replicate the results of the model on **spider-syn**, **spider-dk** and **spider-realistic**, it seems that we need to have the following python scripts which are currently missing in the repo: `seq2seq/datasets/spider-syn/spider-syn.py`, `seq2seq/datasets/spider-dk/spider-dk.py` and `seq2seq/datasets/spider-realistic/spider-realistic.py`

Thanks a ton for assisting with this!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.