github / github/scientist

Per-experiment sampling?

Open
#70 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Ruby
Stars
7.8k
Forks
505
PR merge metrics
No merged PRs in 30d

Description

When using the `science` method in the `Scientist` module, I want to supply an extra parameter that would be used inside the `enabled?` method to determine whether to run the experiment.

The intention is to be able to control, on a per-experiment basis, the percentage of time that the experiment will actually run.

Is something like this possible?

Contributor guide

Open the contributing guide

Research direction

Start by reading the `science` method and the `enabled?` method in the Scientist module to understand how an experiment is selected for execution. Define the per-experiment sampling behavior and its API before implementation; done should include coverage showing that the configured percentage controls whether the experiment runs.

Written by the indexing model from the issue text.

Assessment

Tech stack
ruby
Domain
backend-api-design
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.