adobe / adobe/aem-experimentation

Do not continue serving variant if it was removed from the split traffic

Open
#32 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
16
Forks
14
PR merge metrics
No merged PRs in 30d

Description

At the moment, if you change the split ratio after an experiment ran for a while and assign 0% to one of the variants, you'll still get some traffic from users that have potentially persisted that variant in their local storage.

### Expected Behaviour

If we pull a variant from an experiment, it should not get any traffic anymore.

### Actual Behaviour

The variant still gets traffic once the choice was persisted to the local storage.

Contributor guide

Open the contributing guide

Research direction

Start by tracing how the experiment choice is persisted in local storage and how the current split ratio is applied when selecting a variant. Confirm the behavior with a persisted variant assigned 0% traffic; done means that variant is no longer served after it is removed from the split.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
frontend
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.