Owner

EducationalTestingService

14 indexed repositories · View on GitHub

skll
SciKit-Learn Laboratory (SKLL) makes it easy to run machine learning experiments.

Python · 561 stars
rstfinder
Fast Discourse Parser to find latent Rhetorical STructure (RST) in text.

Python · 128 stars
rsmtool
A Python package to facilitate research on building and evaluating automated scoring models.

Python · 71 stars
metaphor
Metaphor classification for verbs and content words

67 stars
gitlab-to-atlassian
Scripts to help export information from GitLab to Atlassian JIRA and Stash.

Python · 36 stars
gug-data
A dataset of sentences with ordinal labels for grammaticality

29 stars
TOEFL-Spell
Corpus of Annotations for Misspelings

29 stars
match
Match tokenized words and phrases within the original, untokenized, often messy, text.

Python · 20 stars
Confero
Eye-tracking, Screen and Event Capturing System for Windows. A web application running on a separate PC allows for real time monitoring o...

Python · 9 stars
node-zpar
A node package that allows using the ZPar English parser with node.js

JavaScript · 6 stars
factor_analyzer
A Python module to perform exploratory & confirmatory factor analyses.

Python · 6 stars
simpledep
A simple example shift-reduce parser based on a perl version from Kenji Sagae

Python · 5 stars
prmse-simulations
Simulations for the PRMSE automated scoring metric.

Jupyter Notebook · 2 stars
stanford-0mq
An implementation of a server for Stanford's CoreNLP suite using 0mq and JSON.

Java · 0 stars

Beginner friendly Everything

Open All

Add a philosophy page Open

Difficulty 2/5 Half a day Newbie friendliness 48/100

EducationalTestingService/skll#602 · Opened Apr 19, 2020
Add suppress_warnings argument to various metrics Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

EducationalTestingService/rsmtool#411 · 1 comment · Opened Mar 19, 2020
Allow config dictionary to contain dataframe rather than path to a file Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

EducationalTestingService/rsmtool#399 · Opened Mar 11, 2020
Output file or directory in rsmpredict Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

EducationalTestingService/rsmtool#396 · 3 comments · Opened Mar 9, 2020
Make sure that everything that accepts paths also accepts pathlib.Path Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 20/100

EducationalTestingService/rsmtool#385 · Opened Feb 26, 2020
Investigate whether we can use any visualizers from Yellowbrick Open

enhancement help wanted

Difficulty 5/5 Over a week Newbie friendliness 20/100

EducationalTestingService/rsmtool#383 · 1 comment · Opened Feb 25, 2020
Investigate a hyperparameter optimization framework like Optuna Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

EducationalTestingService/skll#591 · 1 comment · 1 reaction · Opened Feb 25, 2020
Exclude unnecessary packages from conda-recipe Open

enhancement

EducationalTestingService/rsmtool#374 · 1 assignee · Opened Feb 20, 2020
Replace all path operations and functions with `pathlib` Open

good first issue help wanted

Difficulty 4/5 3-5 days Newbie friendliness 25/100

EducationalTestingService/rsmtool#370 · 1 comment · Opened Feb 14, 2020
Consistent approach to warnings Open

enhancement help wanted

Difficulty 5/5 Over a week Newbie friendliness 25/100

EducationalTestingService/rsmtool#367 · 5 comments · Opened Feb 14, 2020
Capture incorrect input to correlations Open

enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 50/100

EducationalTestingService/rsmtool#365 · Opened Feb 13, 2020
Modify tests to fix warnings based on SKLL hyperparameters Open

enhancement help wanted

Difficulty 4/5 3-5 days Newbie friendliness 25/100

EducationalTestingService/rsmtool#360 · Opened Feb 11, 2020
Try solution for kernel RuntimeErrors Open

enhancement

EducationalTestingService/rsmtool#350 · 2 comments · 1 assignee · Opened Jan 30, 2020
Resource warning when running tests Open

enhancement

EducationalTestingService/rsmtool#346 · 8 comments · 1 assignee · Opened Jan 28, 2020
Kappa computation when predicted scores are on a different scale Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

EducationalTestingService/rsmtool#342 · 10 comments · Opened Jan 22, 2020
Generate predictions for responses with non-numeric human scores Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

EducationalTestingService/rsmtool#341 · Opened Jan 17, 2020
Add consistency to RSMSummarize output Open

enhancement good first issue

Difficulty 5/5 Over a week Newbie friendliness 15/100

EducationalTestingService/rsmtool#340 · Opened Jan 17, 2020
Compute metrics for all data once Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 48/100

EducationalTestingService/rsmtool#338 · Opened Jan 7, 2020
Consistently show in the report if the features were standardized Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

EducationalTestingService/rsmtool#337 · Opened Jan 7, 2020
Provide descriptives for all features, not just those in the final model Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

EducationalTestingService/rsmtool#336 · Opened Jan 7, 2020
More flexible treatment of continuous co-variates Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

EducationalTestingService/rsmtool#335 · Opened Jan 7, 2020
Look into parallelization Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

EducationalTestingService/rsmtool#334 · 1 comment · Opened Jan 7, 2020
Improve RSMSummarize and RSMCompare tutorials Open

documentation

Difficulty 3/5 1-2 days Newbie friendliness 35/100

EducationalTestingService/rsmtool#333 · Opened Jan 7, 2020
Highlight non-zero differences in RSMCompare Open

enhancement help wanted

Difficulty 3/5 1-2 days Newbie friendliness 35/100

EducationalTestingService/rsmtool#332 · Opened Jan 7, 2020
Match the terminology between RSMTool and RSMCompare Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

EducationalTestingService/rsmtool#330 · Opened Jan 7, 2020
The name of human score column in RSMPredict Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

EducationalTestingService/rsmtool#329 · Opened Jan 7, 2020
Capture warning message from notebook Open

enhancement

EducationalTestingService/rsmtool#320 · 1 assignee · Opened Nov 22, 2019
`mvn package` failing? Open

bug

EducationalTestingService/stanford-0mq#9 · 1 assignee · Opened Oct 23, 2019
Update `roc_auc` metric to support multi-class Open

enhancement help wanted metrics sklearn-compatibility

Difficulty 3/5 1-2 days Newbie friendliness 35/100

EducationalTestingService/skll#554 · Opened Oct 14, 2019
Consider making solver and penalty grid-searchable for LogisticRegression Open

enhancement learners sklearn-compatibility

Difficulty 4/5 3-5 days Newbie friendliness 28/100

EducationalTestingService/skll#535 · 1 comment · Opened Oct 1, 2019
This is also wrong Open

bug

EducationalTestingService/match#8 · 1 assignee · Opened Sep 26, 2019
Incorrect results when the original text contains aribitrary whitespace throughout Open

bug

EducationalTestingService/match#7 · 1 assignee · Opened Sep 25, 2019
What to do with hyphenated words? Open

enhancement question

EducationalTestingService/match#6 · 1 assignee · Opened Sep 25, 2019
Consider parallelizing xval Open

enhancement

EducationalTestingService/skll#523 · 1 assignee · Opened Sep 25, 2019
Allow `features` to take a list of dictionaries Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

EducationalTestingService/rsmtool#298 · Opened Sep 24, 2019
Micro-averaged F1 vs. Accuracy Open

enhancement

EducationalTestingService/skll#491 · 1 assignee · Opened Aug 15, 2019
for the TOEFL-Spell, how to get the context of spell error? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

EducationalTestingService/TOEFL-Spell#1 · 1 comment · 1 reaction · Opened Aug 8, 2019
Add more analyses to RSMCompare/RSMSummarize Open

enhancement help wanted

Difficulty 4/5 3-5 days Newbie friendliness 35/100

EducationalTestingService/rsmtool#260 · Opened Jun 12, 2019
Better documentation for custom learners Open

documentation help wanted

Difficulty 3/5 1-2 days Newbie friendliness 35/100

EducationalTestingService/skll#481 · Opened Apr 11, 2019
Add `inplace=False` argument to `FeatureSet.filter()` Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

EducationalTestingService/skll#477 · 1 comment · Opened Mar 15, 2019
Add feature transformation and truncation to SKLL Open

enhancement

EducationalTestingService/skll#454 · 3 comments · 1 assignee · Opened Feb 6, 2019
Include feature scaling for sparse features Open

enhancement help wanted

Difficulty 3/5 1-2 days Newbie friendliness 42/100

EducationalTestingService/skll#450 · 2 comments · Opened Feb 4, 2019
Not working Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

EducationalTestingService/gitlab-to-atlassian#13 · 1 comment · Opened Jun 22, 2018
More prominent warning for classifiers that do not support expected probabilities Open

enhancement help wanted

Difficulty 4/5 3-5 days Newbie friendliness 25/100

EducationalTestingService/rsmtool#196 · Opened Mar 13, 2018
Improve confusion matrix and score distributions Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

EducationalTestingService/rsmtool#151 · Opened Feb 7, 2018
Save RSMCompare outputs Open

enhancement help wanted

Difficulty 5/5 Over a week Newbie friendliness 20/100

EducationalTestingService/rsmtool#125 · Opened Jan 19, 2018
Make stacking available in SKLL Open

enhancement

EducationalTestingService/skll#401 · 7 comments · 1 assignee · Opened Dec 14, 2017
Need for a generic data export script Open

enhancement High Priority

EducationalTestingService/Confero#108 · 1 assignee · Opened Nov 16, 2017
SSA conversion fails again Open

bug

EducationalTestingService/Confero#107 · 1 comment · 1 assignee · Opened Nov 16, 2017
Support for CCG Parser Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

EducationalTestingService/node-zpar#1 · 5 comments · Opened May 12, 2015

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

EducationalTestingService

Showing the newest 100

Get new issues in your inbox