jacob-long / jacob-long/interactions

Difference between "significant' and "not significant" is not itself statistically significant

Open
#67 2 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
R
Stars
135
Forks
19
PR merge metrics
No merged PRs in 30d

Description

I just learned about Johnson-Neyman plot this morning when I saw [a Stack Overflow question about the `interactions` package.](https://stackoverflow.com/questions/75911846/disparity-between-sim-slopes-johnson-neyman-and-prob-interaction-in-r)

I wonder if it would be a good idea for the documentation to refer to the classic Gelman & Stern paper [The Difference Between “Significant” and “Not Significant” is not Itself Statistically Significant](http://www.stat.columbia.edu/~gelman/research/published/signif4.pdf)

This is obviously not a technical issue with your package (which is great!), but highlighting significant and non-significant regions with sharply different colors might encourage bad statistical practice.

Contributor guide

No contributing guide indexed for this repository

Research direction

Review the documentation for Johnson-Neyman plots and how significant and non-significant regions are currently presented. Check the linked Gelman and Stern paper, then update the relevant guidance to address interpretation and color-based emphasis; done when the documentation clearly explains the concern and cites the paper.

Written by the indexing model from the issue text.

Assessment

Tech stack
r
Domain
documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.