facebookexperimental / facebookexperimental/Robyn
Question about CI calculation when CPA = Inf in models with dep_var_type = "conversion"
- Dominant language
- Jupyter Notebook
- Stars
- 1.5k
- Forks
- 433
- PR merge metrics
- No merged PRs in 30d
Description
Hi, I'm using Robyn v3.11.1 and running a model with `dep_var_type = "conversion"` (the paid media metrics are expressed as CPA). I have a question regarding the "In-cluster bootstrapped CPA [95% CI & mean]" chart.
**Observed behavior:**
In one of the results, a paid media channel shows a **CPA value of Inf**, but its confidence interval (CI) appears as **[0, 5.3]**:
While this is not technically impossible, I wanted to validate this, so I checked the Pareto_aggregated.csv file.
Filtering by the specific paid media and the cluster of the model, I found a total of **98 models**, of which **88 have CPA = Inf**, and **only 10 have finite CPA values**.
**My interpretation:**
It seems that the CI is being calculated **only from the models that have finite CPA**, excluding those with CPA = Inf. That would explain the CI range of [0, 5.3].
However, I wonder if this is the correct approach. Given that most models have CPA = Inf, wouldn't it be more representative to include those values in the CI calculation? In that case, **shouldn't the CI be [0, Inf]**?
Thanks in advance for your help! Let me know if you need more information.
Contributor guide
Assessment
This issue has not been assessed yet.