CentreForDigitalHumanities / CentreForDigitalHumanities/langpro-annotator

Original sources of the initial NLI datasets

Open
#27 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
0
Forks
0
Avg merge
5d 11h
Merged PRs (30d)
2

Description

**SICK**
paper: https://aclanthology.org/L14-1314/
dataset: https://alt.qcri.org/semeval2014/task1/index.php?id=data-and-tools (the page lacks style files)
The dataset has three splits: train, trial, test
This differs from another [source](https://marcobaroni.org/composes/sick.html) as it contains slightly more problems and has been used by more systems.

**FraCaS**
paper: https://gu-clasp.github.io/multifracas/D16.pdf
dataset: https://nlp.stanford.edu/~wcmac/downloads/fracas.xml

**Stanford NLI (SNLI)**
paper: https://aclanthology.org/D15-1075/
dataset: https://nlp.stanford.edu/projects/snli/

While adding NLI problems from these datasets, the metadata of each problem needs to be determined, e.g., gold label, original id, annotator labels (if any), etc.
I am happy to work on it as I am well aware of the relevant meta data per dataset.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.