pytest-dev / pytest-dev/pytest-xdist

Limit tasks per worker

Open
#329 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement help wanted
Dominant language
Python
Stars
1.9k
Forks
287
Avg merge
9h 30m
Merged PRs (30d)
2

Description

I can't seem to find any support to control the number of tasks a worker is allowed to process. I am thinking something similar to maxtasksperchild when creating a pool https://docs.python.org/2/library/multiprocessing.html#module-multiprocessing.pool.

Some of my tests use a library the uses gobal data structures that will conflict across tests. Is there an option for one worker per test?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or entry points. Start by tracing how pytest-xdist creates and schedules workers, then compare the requested per-worker task limit with Python multiprocessing's maxtasksperchild behavior. Done means users can configure a worker task limit or one worker per test, with tests covering the setting and its interaction with worker scheduling.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
distributed-systems, testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.