the result changes across different runs, how to interpret the result?
Nobody has claimed this yet.
- Dominant language
- Jupyter Notebook
- Stars
- 4.8k
- Forks
- 827
- PR merge metrics
- No merged PRs in 30d
Description
Dear Authors
Thanks for your great work.
I am trying to use the DeepIVEstimator to estimate treatment effect for a dataset. I am getting different estimated treatment effect each time I run the estimator. Do you have any suggestion on how to interpret the outputs (i.e., the estimated treatment effect). Shall we average the result across multiple runs?
from econml.deepiv import DeepIVEstimator
treatment_model = ...
response_model = ...
keras_fit_options = ...
deepIvEst = DeepIVEstimator(...)
deepIvEst.fit(Y=our_Y,T=our_T,X=our_X,Z=our_Z)
treatment_effects = deepIvEst.effect(X = our_X_test, T0 = T0, T1 = T1)
Thank you!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the run-to-run variation through DeepIVEstimator.fit and effect with the supplied treatment, response, feature, and instrument inputs. Determine what the estimator outputs mean and whether averaging multiple runs is appropriate, then document the explanation and any relevant reproducibility guidance.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- keras, python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100