exercism / exercism/python-test-runner

Find a way to filter concept exercises by taskno from the command line (concept exercises)

Open
#87 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
13
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Hi,
Pytest test suites in Exercism contain custom marks in the form of `@pytest.mark.task(taskno=X)` where X is a whole number. At least in concept exercises, this number corresponds to the task inside the supplied README file.
While doing a concept exercise, I wanted to select pytest tests to run and filter them by this `taskno` parameter but failed to do so. What I tried:
1) @BethanyG sent me a [link to StackOverflow thread which shows one similar problem](https://stackoverflow.com/questions/67200501/pytest-run-only-tests-with-specific-marker-attribute):

However, the example code allows to run marks with arguments looking like this:
`@pytest.mark.task("taskno1")`

Perhaps there is a way to modify something in the conftest functions but I haven't wrapped my head around it.

2) I tried a plugin called [pytest-pilot](https://smarie.github.io/python-pytest-pilot/)

It supplies easier syntax for solving similar problems as `1` but also didn't help me solve the problem. I would get an error `IndexError: tuple index out of range`.

What I use now:
1) `pytest -k keyword_you_need`
It usually works, but sometimes I still select more of fewer tests than needed
2) `pytest --tb=short`
I don't like long error messages from pytests so this is another way to limit pytest from adding too much unwanted output.

Filtering by task number would be "nice to have", but I think solving this problem is interesting in itself. All help is welcome :)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.