tarantool / tarantool/tarantool

test-run: fragile list cause to fail runs with 'reproduce' flag

Open
#5,170 0 comments 0 reactions 1 assignee View on GitHub

@avtikhon is already working on this.

Since Jul 15, 2020.

qa
Dominant language
Lua
Stars
3.7k
Forks
419
Avg merge
1d 23h
Merged PRs (30d)
88

Description

Tarantool version:

OS version:

Bug description:
test-run tool sets tests from fragile list in suite.ini file to 'fragile' standalone suite, is cause the 'reproduce' flag to fail on its use, like:

./test-run.py --reproduce box.list.yaml
Started ./test-run.py --reproduce box.list.yaml
Running in parallel with 2 workers

Traceback (most recent call last):
  File "./test-run.py", line 218, in <module>
    status = main_parallel()
  File "./test-run.py", line 133, in main_parallel
    res = main_loop_parallel()
  File "./test-run.py", line 88, in main_loop_parallel
    task_groups = lib.worker.reproduce_task_groups(task_groups)
  File "/home/vagrant/tnt/test-run/lib/worker.py", line 118, in reproduce_task_groups
    '[reproduce] Given tests contained by different suites')
ValueError: [reproduce] Given tests contained by different suites

Steps to reproduce:

Optional (but very desirable):

  • coredump
  • backtrace
  • netstat

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.