MarketSquare / MarketSquare/robotframework-stacktrace

The test suite is failing

Open
#4 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
18
Forks
2
PR merge metrics
No merged PRs in 30d

Description

Hi,

Perhaps I'm doing something wrong, but here's what I get when running `python -m robot tests` on the latest 0.4.1 release (archive from PyPI):

```
starting phase `check'
==============================================================================
Tests
==============================================================================
Tests.A-Suite
==============================================================================
Tests.A-Suite.B-Suite
==============================================================================
Tests.A-Suite.B-Suite.C-Suite
==============================================================================
Tests.A-Suite.B-Suite.C-Suite.D-Suite
==============================================================================
first teardown fail | FAIL |
Teardown failed:
by purpose
------------------------------------------------------------------------------
Second setup fails | FAIL |
Setup failed:
'False' should be true.

Also teardown failed:
this fails as well
------------------------------------------------------------------------------
Tests.A-Suite.B-Suite.C-Suite.D-Suite | FAIL |
Suite teardown failed:
'False' should be true.

2 tests, 0 passed, 2 failed
==============================================================================
Tests.A-Suite.B-Suite.C-Suite | FAIL |
2 tests, 0 passed, 2 failed
==============================================================================
Tests.A-Suite.B-Suite.C2-Suite
==============================================================================
Tests.A-Suite.B-Suite.C2-Suite.Never Runs
==============================================================================
Hi | FAIL |
Parent suite setup failed:
This is a Suite Setup
------------------------------------------------------------------------------
Tests.A-Suite.B-Suite.C2-Suite.Never Runs | FAIL |
Parent suite setup failed:
This is a Suite Setup

1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite.C2-Suite | FAIL |
Suite setup failed:
This is a Suite Setup

Also suite teardown failed:
Here the teardow

1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite.C3-Suite
==============================================================================
Tests.A-Suite.B-Suite.C3-Suite.Fails Suite Teardown
==============================================================================
Test | PASS |
------------------------------------------------------------------------------
Tests.A-Suite.B-Suite.C3-Suite.Fails Suite Teardown | FAIL |
Suite teardown failed:
in Suite Teardown

1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite.C3-Suite | FAIL |
1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite | FAIL |
Suite teardown failed:
This Fails as well....

4 tests, 0 passed, 4 failed
==============================================================================
Tests.A-Suite | FAIL |
4 tests, 0 passed, 4 failed
==============================================================================
[ ERROR ] Error in file '/tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/tests/basics.robot' on line 4: Resource file 'keywords.resource' does not exist.
Tests.Basics
==============================================================================
PASS Testing 1 | PASS |
------------------------------------------------------------------------------
Testing 1 | FAIL |
1 != 2
------------------------------------------------------------------------------
Testing 2 | FAIL |
No keyword with name 'Keyword2' found. Did you mean:
Keyword
BuiltIn.Run Keyword
------------------------------------------------------------------------------
Resolve Variable | FAIL |
scalar content
------------------------------------------------------------------------------
Fail with a List | FAIL |
Lists are different:
Index 2: three != 3
------------------------------------------------------------------------------
Fail with dict | FAIL |
Dictionary does not contain key 'key'.
------------------------------------------------------------------------------
Fail expanded keys | FAIL |
Keyword 'Fail Expanded' got unexpected named arguments 'key1' and 'key2'.
------------------------------------------------------------------------------
Fail expanded items | FAIL |
['key1', 'key2']
------------------------------------------------------------------------------
Fail expanded list | FAIL |
['one', 'two', 'three']
------------------------------------------------------------------------------
Fail with large file | FAIL |
This file is full of vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit
vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit
vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit v...
[ Message content over the limit has been removed. ]
...mit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit
vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit

!= puke
------------------------------------------------------------------------------
Fail with number | FAIL |
1775675 != 23
------------------------------------------------------------------------------
Fails with Unknown Variable | FAIL |
Variable '${unknown_var}' not found.
------------------------------------------------------------------------------
Fail a compount | FAIL |
this is a scalar content text with a ['one', 'two', 'three']
------------------------------------------------------------------------------
Wrong If | FAIL |
Evaluating expression 'time.seven' failed: AttributeError: module 'time' has no attribute 'seven'
------------------------------------------------------------------------------
Tests.Basics | FAIL |
14 tests, 1 passed, 13 failed
==============================================================================
Tests.RunKeywords and WUKS
==============================================================================
Tests.RunKeywords and WUKS.Run Keywords WUKS
==============================================================================
Run Keyword | FAIL |
This one fails
------------------------------------------------------------------------------
Run Keyword And Ignore Error | PASS |
------------------------------------------------------------------------------
Run Keyword And Continue On Failure | FAIL |
Several failures occurred:

1) 1st Error

2) 2nd Error

3) 3rd Error

4) 4th Error

5) 5th Error
------------------------------------------------------------------------------
Run Keyword And Expect Error | PASS |
------------------------------------------------------------------------------
Run Keyword And Return | FAIL |
Evaluating expression '" ".join(None)' failed: TypeError: can only join an iterable
------------------------------------------------------------------------------
Run Keyword And Return If | FAIL |
Evaluating expression '" ".join(None)' failed: TypeError: can only join an iterable
------------------------------------------------------------------------------
Run Keyword And Return Status | FAIL |
'False' should be true.
------------------------------------------------------------------------------
Run Keyword And Warn On Failure [ WARN ] Executing keyword 'Top Level One' failed:
This should basically be a warning
| PASS |
------------------------------------------------------------------------------
Run Keywords | FAIL |
with a message
------------------------------------------------------------------------------
Pass WUKS | PASS |
------------------------------------------------------------------------------
Fail in WUKS | FAIL |
Keyword 'Fails some times' failed after retrying 9 times. The last error was: 10 != 9
------------------------------------------------------------------------------
Tests.RunKeywords and WUKS.Run Keywords WUKS | FAIL |
11 tests, 4 passed, 7 failed
==============================================================================
Tests.RunKeywords and WUKS | FAIL |
11 tests, 4 passed, 7 failed
==============================================================================
Tests.Side-Effecting
==============================================================================
Side effect in variable resolving | PASS |
------------------------------------------------------------------------------
Side effect in variable resolving FAILING | FAIL |
a
------------------------------------------------------------------------------
Tests.Side-Effecting | FAIL |
2 tests, 1 passed, 1 failed
==============================================================================
Tests | FAIL |
31 tests, 6 passed, 25 failed
==============================================================================
Output: /tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/output.xml
Log: /tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/log.html
Report: /tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/report.html
error: in phase 'check': uncaught exception:
%exception #<&invoke-error program: "python" arguments: ("-m" "robot" "tests") exit-status: 25 term-signal: #f stop-signal: #f>
phase `check' failed after 0.5 seconds
command "python" "-m" "robot" "tests" failed with status 25
```
Ideas?

The only direct dependencies are python-robotframework@4.1.2 and python@3.9.6.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the report with `python -m robot tests` using the 0.4.1 release. Start with the `tests` directory and the error in `tests/basics.robot` about the missing `keywords.resource` file, then investigate the reported setup, teardown, and test failures. Done means the test suite runs without these reported failures.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.