How do you get results for dev_data with squad official evaluator?
Open
- Dominant language
- Python
- Stars
- 1.5k
- Forks
- 667
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
How do you get results for dev_data in the readme.txt. It is mentioned the results was got with squad official evaluator. Do you need to change any code, or just use
```
python squad/evaluate-v1.1.py $HOME/data/squad/dev-v1.1.json out/basic/00/answer/dev-####.json
```
I got the dev_f1 ~44.0 when I try. There is such a large gap. Could anyone can share your practice?
Thanks,
Allen.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.