statsmodels / statsmodels/statsmodels

nonparametric: TestRegCoefC need checking, better tests

Open
#614 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

comp-nonparametric
Dominant language
Python
Stars
11.6k
Forks
3.6k
Avg merge
7h 37m
Merged PRs (30d)
96

Description

We should return the p-value and attach relevant variables (I added the bootstrap t_dist in my branch)

My first example reports "Not Significant" even though the parameters are large. Another run has significant at 10% without pivot, and at 1% with pivot. looks fine.
The test statistic and the bootstrap distribution have small values in my example. Should there be a normalization also in the pivot=False case?

the test only checks whether "Not Significant" is reported or not, but not any numbers


versions of the test

Racine, J. (1997): "Consistent Significance Testing for Nonparametric Regression" is not cited in the book
Book, R package np, and
Racine, J.S., J. Hart, and Q. Li (2006), “Testing the significance of categorical predictor variables
in nonparametric regression models,” Econometric Reviews, 25, 523-544.
use wild bootstrap

Racine, J.S., J. Hart, and Q. Li (2006) first bootstrap method is residual as the one implemented here.

Book has other tests in section 12.3.4, looks a bit similar to TestFForm.

  • given that most pieces and the basic structure is available, it might be possible to offer more choices
    without a big amount of extra work

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at TestRegCoefC and the existing test that checks only whether "Not Significant" is reported. Compare its behavior with the cited book and R package np references, including residual or wild bootstrap variants and pivot normalization. Done means returning the p-value and relevant variables while adding tests that check numeric results and the reported significance.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, testing-qa
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.