EducationalTestingService / EducationalTestingService/rsmtool
Improve confusion matrix and score distributions
Open
enhancement
- Dominant language
- Python
- Stars
- 71
- Forks
- 21
- PR merge metrics
- No merged PRs in 30d
Description
Right now, the confusion matrix and the score distribution plots rely entirely on the test set human scores. This means that if there are, say, 6s in the training data but none in the test data, the confusion matrix will only be 5x5 and the score distribution plot will only show 5 bars. Perhaps it would be better to take the union of the human scores from both the training and the test sets?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.