py-why / py-why/EconML

Question about `ate_inference()`

Open
#993 6 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Jupyter Notebook
Stars
4.8k
Forks
827
PR merge metrics
No merged PRs in 30d

Description

Hello,

I have a question regarding the standard error computation in ate_inference() when X is not None.

For a linear CATE model, $\tau(x) = \psi(x)'\beta$, the ATE is $\theta = \Psi'\beta$, where $\Psi = E[\psi(X)]$.

The point estimate $\hat{\theta} = \hat{\Psi}'\hat{\beta}$ (where $\hat{\Psi} = \frac{1}{n}\sum_{i=1}^n \psi(X_i)$ and $\hat{\beta}$ are the final model coefficients) aligns with ate_inference().

However, it appears that ate_inference() calculates the standard error as $\sqrt{\hat{\Psi}' \hat{V} \hat{\Psi}}$, treating $\hat{\Psi}$ as a constant and disregarding its sampling variation.

Wouldn't it be preferable to use the Delta Method for standard error calculation in this case?

I'd appreciate your insights on this matter.

Thank you!

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at the EconML implementation of ate_inference() for the X is not None path and trace how the linear CATE estimate and covariance are used. Compare the current standard-error calculation with the proposed Delta Method, then establish a documented decision and validation for the sampling variation of Ψ.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.