google / google/CausalImpact

Power Analysis for Geo experiments

Open
#67 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
R
Stars
1.9k
Forks
264
PR merge metrics
No merged PRs in 30d

Description

Hi team - Thanks for the amazing package.

I am looking for ideas/suggestions for doing power analysis for geo experiment. To give more context, I have a marketing intervention to test and have pre selected comparable Geos (control and treatment) to run the test on. I will be using causal impact to measure the lift of the intervention. How can I check the minimum detectable effect under this setting. I have control/test Geos, duration of the intervention and default significance levels. I would like to know the MDE - smallest treatment effect that can be measure using causalimpact technique. This key since if from business intuition this MDE is not within the range of possibility I might want to suggest a different treatment.

I am guessing this would involve simulation with adding known effects, wanted to understand if there are known functions/packages for this usecase.

Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.