lookit / lookit/lookit-api

Cap # of participants and balance data collection among age ranges

Open
#772 2 comments 0 reactions 1 assignee View on GitHub

@becky-gilbert is already working on this.

Since Jan 28, 2026.

Discussion Feature Scoping
Dominant language
Python
Stars
12
Forks
21
Avg merge
5d 19h
Merged PRs (30d)
5

Description

# TL;DR
Cap # of participants and balance data collection among age ranges

# Narrative
Right now, researchers have to track manually how many children participated in the study, how many children were assigned to a specific age range and how many participants were assigned to a specific list or condition. Ideally, the researcher would define this information in the study editor and Lookit would automatically cap the number of participants in each age range and make sure that the # of participants assignated to each list/condition is balanced among age ranges. For example, a researcher wants to test 24 4-5 month-olds and 24 6-7 month-olds in a study with 4 conditions. The researcher wants an equal number of participants of each age group assigned to each condition (i.e. 6 participants per condition in each age group). Right now, the researcher should check how many children have participated in each age range and remove the age range manually when it gets to 24 participants. Moreover, there is no way to make sure that from the 24 participants in each age group, 6 of them are assigned to condition 1, 6 to condition 2, and so on. For example, it may happen that condition 1 is only assigned to 4-5 month-olds. Thus, the researcher may need to remove manually the lists/conditions that are full and test additional participants to make sure that all conditions have enough number of participants. If the researcher was able to define this information in the study editor, Lookit could automatically track the participation, cap the number of participants and optimize the assignation of participants to balance data collection among age ranges.

To ensure that researchers do not test more participants than what they need and that the collected data is properly balanced. This feature is particularly critical for studies that test more than one age range in the same study.

# Acceptance Criteria
- [ ] Researcher will need a UI to set number of responses for specific age range.
- [ ] Researcher might need a UI to have a response not be applied to the above age range response count. For example, the response is of mediocre quality, so they might want to allow more response for an age range.
- [ ] Researcher might want to adjust their cap on an age range after collecting some responses.
- [ ] Experiments would have to be unavailable to participants where their criteria has already received enough responses
- [ ] Tests for new feature
- [ ] QA on new feature

# Note
This issue needs some work. There's a lot here and what is needed feels nebulous.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.