awslabs / awslabs/gap-text2sql

How to comprehend the evaluation results?

Open
#7 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
109
Forks
25
PR merge metrics
No merged PRs in 30d

Description

Hello,
when I get the evaluation results,I am not sure the meaning of "predicted_parse_error" and "exact".I guess when "predicted_parse_error" is true it means the model can’t produce a predicted sql,is that right?And I found "exact" has 3 possibilities:true,0 and false,I guess when "exact" is true ,it means the predicted sql is right.But what do 0 and false mean?
Thank you.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.