EducationalTestingService / EducationalTestingService/rsmtool

Add suppress_warnings argument to various metrics

Open
#411 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
71
Forks
21
PR merge metrics
No merged PRs in 30d

Description

The functions for computing individual metrics raise warning in edge cases (for example, when standard deviation is zero). In some cases this can result in multiple warnings which all have the same underlying cause. For example, in case of DSM the user will see a warning for each subgroup.

For users who call the tool from command line or using the top-level API function `run_*`, we could display a single warning pointing out the issue and suppress subsequent warnings raised by each function through an optional `suppress_warnings` argument. The default value will be `False`.

This would require carefully working through different metrics to make sure we do not suppress any unrelated warnings.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.