pytest-dev / pytest-dev/pytest-xdist
Ability to scale more workers with remote execute
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.9k
- Forks
- 287
- Avg merge
- 9h 30m
- Merged PRs (30d)
- 2
Description
Hi,
I would like to know if it's possible to run more workers than the CPU # on a single machine. I was think remote Socket Servers is a way to go, but it doesn't seem to work the way I needed( Workers are run locally?).
What I am trying to do:
pytest -n auto --dist=loadscope --tx socket=<second test server ip>:8888 --rsyncdir tests
To get tests loadbalance between two test servers
Any suggestions how I could scale up the tests run in parallel?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the command using pytest -n auto with --dist=loadscope, --tx socket=:8888, and --rsyncdir tests. Read the remote Socket Server behavior and determine whether workers are launched locally or on the second server. Done means tests are load-balanced across both test servers with more workers than one machine's CPU count.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- distributed-systems, testing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100