facebookexperimental / facebookexperimental/Robyn

Question about CI calculation when CPA = Inf in models with dep_var_type = "conversion"

Open
#1,300 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
1.5k
Forks
433
PR merge metrics
No merged PRs in 30d

Description

Hi, I'm using Robyn v3.11.1 and running a model with `dep_var_type = "conversion"` (the paid media metrics are expressed as CPA). I have a question regarding the "In-cluster bootstrapped CPA [95% CI & mean]" chart.

**Observed behavior:**
In one of the results, a paid media channel shows a **CPA value of Inf**, but its confidence interval (CI) appears as **[0, 5.3]**:

Image

While this is not technically impossible, I wanted to validate this, so I checked the Pareto_aggregated.csv file.
Filtering by the specific paid media and the cluster of the model, I found a total of **98 models**, of which **88 have CPA = Inf**, and **only 10 have finite CPA values**.

Image

**My interpretation:**
It seems that the CI is being calculated **only from the models that have finite CPA**, excluding those with CPA = Inf. That would explain the CI range of [0, 5.3].
However, I wonder if this is the correct approach. Given that most models have CPA = Inf, wouldn't it be more representative to include those values in the CI calculation? In that case, **shouldn't the CI be [0, Inf]**?

Thanks in advance for your help! Let me know if you need more information.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.