MarketSquare / MarketSquare/robotframework-stacktrace

The test suite is failing

Đang mở

#4 mở ngày 3/12/2021 0 bình luận 0 reaction 0 người được giao Xem trên GitHub

Chưa có ai nhận issue này.

Ngôn ngữ chính: Python
Star: 18
Fork: 2
Chỉ số merge pull request: Không có pull request nào được merge trong 30 ngày

Mô tả

Hi,

Perhaps I'm doing something wrong, but here's what I get when running python -m robot tests on the latest 0.4.1 release (archive from PyPI):

starting phase `check'
==============================================================================
Tests                                                                         
==============================================================================
Tests.A-Suite                                                                 
==============================================================================
Tests.A-Suite.B-Suite                                                         
==============================================================================
Tests.A-Suite.B-Suite.C-Suite                                                 
==============================================================================
Tests.A-Suite.B-Suite.C-Suite.D-Suite                                         
==============================================================================
first teardown fail                                                   | FAIL |
Teardown failed:
by purpose
------------------------------------------------------------------------------
Second setup fails                                                    | FAIL |
Setup failed:
'False' should be true.

Also teardown failed:
this fails as well
------------------------------------------------------------------------------
Tests.A-Suite.B-Suite.C-Suite.D-Suite                                 | FAIL |
Suite teardown failed:
'False' should be true.

2 tests, 0 passed, 2 failed
==============================================================================
Tests.A-Suite.B-Suite.C-Suite                                         | FAIL |
2 tests, 0 passed, 2 failed
==============================================================================
Tests.A-Suite.B-Suite.C2-Suite                                                
==============================================================================
Tests.A-Suite.B-Suite.C2-Suite.Never Runs                                     
==============================================================================
Hi                                                                    | FAIL |
Parent suite setup failed:
This is a Suite Setup
------------------------------------------------------------------------------
Tests.A-Suite.B-Suite.C2-Suite.Never Runs                             | FAIL |
Parent suite setup failed:
This is a Suite Setup

1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite.C2-Suite                                        | FAIL |
Suite setup failed:
This is a Suite Setup

Also suite teardown failed:
Here the teardow

1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite.C3-Suite                                                
==============================================================================
Tests.A-Suite.B-Suite.C3-Suite.Fails Suite Teardown                           
==============================================================================
Test                                                                  | PASS |
------------------------------------------------------------------------------
Tests.A-Suite.B-Suite.C3-Suite.Fails Suite Teardown                   | FAIL |
Suite teardown failed:
in Suite Teardown

1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite.C3-Suite                                        | FAIL |
1 test, 0 passed, 1 failed
==============================================================================
Tests.A-Suite.B-Suite                                                 | FAIL |
Suite teardown failed:
This Fails as well....

4 tests, 0 passed, 4 failed
==============================================================================
Tests.A-Suite                                                         | FAIL |
4 tests, 0 passed, 4 failed
==============================================================================
[ ERROR ] Error in file '/tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/tests/basics.robot' on line 4: Resource file 'keywords.resource' does not exist.
Tests.Basics                                                                  
==============================================================================
PASS Testing 1                                                        | PASS |
------------------------------------------------------------------------------
Testing 1                                                             | FAIL |
1 != 2
------------------------------------------------------------------------------
Testing 2                                                             | FAIL |
No keyword with name 'Keyword2' found. Did you mean:
    Keyword
    BuiltIn.Run Keyword
------------------------------------------------------------------------------
Resolve Variable                                                      | FAIL |
scalar content
------------------------------------------------------------------------------
Fail with a List                                                      | FAIL |
Lists are different:
Index 2: three != 3
------------------------------------------------------------------------------
Fail with dict                                                        | FAIL |
Dictionary does not contain key 'key'.
------------------------------------------------------------------------------
Fail expanded keys                                                    | FAIL |
Keyword 'Fail Expanded' got unexpected named arguments 'key1' and 'key2'.
------------------------------------------------------------------------------
Fail expanded items                                                   | FAIL |
['key1', 'key2']
------------------------------------------------------------------------------
Fail expanded list                                                    | FAIL |
['one', 'two', 'three']
------------------------------------------------------------------------------
Fail with large file                                                  | FAIL |
This file is full of vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit
 vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit
  vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit v...
    [ Message content over the limit has been removed. ]
...mit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit
                 vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit vomit









 != puke
------------------------------------------------------------------------------
Fail with number                                                      | FAIL |
1775675 != 23
------------------------------------------------------------------------------
Fails with Unknown Variable                                           | FAIL |
Variable '${unknown_var}' not found.
------------------------------------------------------------------------------
Fail a compount                                                       | FAIL |
this is a scalar content text with a ['one', 'two', 'three']
------------------------------------------------------------------------------
Wrong If                                                              | FAIL |
Evaluating expression 'time.seven' failed: AttributeError: module 'time' has no attribute 'seven'
------------------------------------------------------------------------------
Tests.Basics                                                          | FAIL |
14 tests, 1 passed, 13 failed
==============================================================================
Tests.RunKeywords and WUKS                                                    
==============================================================================
Tests.RunKeywords and WUKS.Run Keywords WUKS                                  
==============================================================================
Run Keyword                                                           | FAIL |
This one fails
------------------------------------------------------------------------------
Run Keyword And Ignore Error                                          | PASS |
------------------------------------------------------------------------------
Run Keyword And Continue On Failure                                   | FAIL |
Several failures occurred:

1) 1st Error

2) 2nd Error

3) 3rd Error

4) 4th Error

5) 5th Error
------------------------------------------------------------------------------
Run Keyword And Expect Error                                          | PASS |
------------------------------------------------------------------------------
Run Keyword And Return                                                | FAIL |
Evaluating expression '" ".join(None)' failed: TypeError: can only join an iterable
------------------------------------------------------------------------------
Run Keyword And Return If                                             | FAIL |
Evaluating expression '" ".join(None)' failed: TypeError: can only join an iterable
------------------------------------------------------------------------------
Run Keyword And Return Status                                         | FAIL |
'False' should be true.
------------------------------------------------------------------------------
Run Keyword And Warn On Failure                                       [ WARN ] Executing keyword 'Top Level One' failed:
This should basically be a warning
| PASS |
------------------------------------------------------------------------------
Run Keywords                                                          | FAIL |
with a message
------------------------------------------------------------------------------
Pass WUKS                                                             | PASS |
------------------------------------------------------------------------------
Fail in WUKS                                                          | FAIL |
Keyword 'Fails some times' failed after retrying 9 times. The last error was: 10 != 9
------------------------------------------------------------------------------
Tests.RunKeywords and WUKS.Run Keywords WUKS                          | FAIL |
11 tests, 4 passed, 7 failed
==============================================================================
Tests.RunKeywords and WUKS                                            | FAIL |
11 tests, 4 passed, 7 failed
==============================================================================
Tests.Side-Effecting                                                          
==============================================================================
Side effect in variable resolving                                     | PASS |
------------------------------------------------------------------------------
Side effect in variable resolving FAILING                             | FAIL |
a
------------------------------------------------------------------------------
Tests.Side-Effecting                                                  | FAIL |
2 tests, 1 passed, 1 failed
==============================================================================
Tests                                                                 | FAIL |
31 tests, 6 passed, 25 failed
==============================================================================
Output:  /tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/output.xml
Log:     /tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/log.html
Report:  /tmp/guix-build-python-robotframework-stacktrace-0.4.1.drv-0/robotframework-stacktrace-0.4.1/report.html
error: in phase 'check': uncaught exception:
%exception #<&invoke-error program: "python" arguments: ("-m" "robot" "tests") exit-status: 25 term-signal: #f stop-signal: #f> 
phase `check' failed after 0.5 seconds
command "python" "-m" "robot" "tests" failed with status 25

Ideas?

The only direct dependencies are python-robotframework@4.1.2 and python@3.9.6.

Hướng dẫn đóng góp

Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này

Bắt đầu từ đâu

Đọc hết issue, rồi đọc hướng dẫn đóng góp của dự án.
Bình luận trên issue rằng bạn sẽ nhận — tránh hai người làm cùng một việc.
Fork repository và làm thay đổi trên một nhánh.
Mở pull request có tham chiếu số hiệu của issue.

Hướng nghiên cứu

Tái hiện báo cáo bằng python -m robot tests với bản phát hành 0.4.1. Bắt đầu với thư mục tests và lỗi trong tests/basics.robot về tệp keywords.resource bị thiếu, sau đó điều tra các lỗi setup, teardown và kiểm thử đã được báo cáo. Được coi là hoàn tất khi bộ kiểm thử chạy mà không có các lỗi đã báo cáo này.

Do mô hình lập chỉ mục viết ra từ nội dung của issue.

Đánh giá

Công nghệ: python
Lĩnh vực: testing-qa
Loại issue: Lỗi
Độ khó: 4/5
Thời gian dự kiến: 3-5 ngày
Mức độ hoạt động: Đình trệ
Độ rõ ràng: Cần làm rõ
Mức phù hợp với người mới: 20/100