microsoft / microsoft/onnxruntime

[Build] Failed test XnnpackEP.TestQDQConvS8S8_per_channel

Open
#14,571 2 comments 0 reactions 1 assignee Claimed by @wejoncy View on GitHub
build ep:Xnnpack
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the issue

when build from a clean master checkout
```
./build.sh --parallel 8 --config Release --use_xnnpack
```
I get two failed xnnpack tests
```
1: [ FAILED ] XnnpackEP.TestQDQConvS8S8_per_channel
1: [ FAILED ] XnnpackEP.TestConvTranspose_qdq
```

### Urgency

_No response_

### Target platform

Linux x86_64

### Build script

`./build.sh --parallel 8 --config Release --use_xnnpack`

### Error / output

I get
```
1: [ RUN ] XnnpackEP.TestQDQConvS8S8_per_channel
1: 2023-02-03 12:22:34.985051001 [W:onnxruntime:xnnpack_qdq_test_graph_conv_s8s8_perchannel, session_state.cc:1136 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
1: 2023-02-03 12:22:34.985087567 [W:onnxruntime:xnnpack_qdq_test_graph_conv_s8s8_perchannel, session_state.cc:1138 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assignments.
1: /home/zhukov/clients/rbx/onnxruntime/onnxruntime/test/util/test_utils.cc:50: Failure
1: Value of: ltensor.DataAsSpan()
1: Expected: contains 21632 values, where each value and its corresponding value in 16-byte object <80-54 00-00 00-00 00-00 40-BA 2D-40 E2-7F 00-00> are an almost-equal pair
1: Actual: 16-byte object <80-54 00-00 00-00 00-00 80-E7 3C-40 E2-7F 00-00>, where the value pair (8.1733408, 6.53867292) at index #704 don't match, which is -1.63467 from 8.17334
1: Google Test trace:
1: /home/zhukov/clients/rbx/onnxruntime/onnxruntime/test/common/tensor_op_test_utils.cc:14: ORT test random seed: 2900955797
1: [ FAILED ] XnnpackEP.TestQDQConvS8S8_per_channel (15 ms)
```

and
```
1: [ RUN ] XnnpackEP.TestConvTranspose_qdq
1: 2023-02-03 12:22:35.071365265 [W:onnxruntime:test_conv_follow_convtrans_s8, session_state.cc:1136 VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which ma
y or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related ops to CPU to improve perf.
1: 2023-02-03 12:22:35.071381179 [W:onnxruntime:test_conv_follow_convtrans_s8, session_state.cc:1138 VerifyEachNodeIsAssignedToAnEp] Rerunning with verbose output on a non-minimal build will show node assign
ments.
1: /home/zhukov/clients/rbx/onnxruntime/onnxruntime/test/util/test_utils.cc:50: Failure
1: Value of: ltensor.DataAsSpan()
1: Expected: contains 4968 values, where each value and its corresponding value in 16-byte object <68-13 00-00 00-00 00-00 40-69 2D-40 E2-7F 00-00> are an almost-equal pair
1: Actual: 16-byte object <68-13 00-00 00-00 00-00 80-48 3C-40 E2-7F 00-00>, where the value pair (3.6200695, 4.22341442) at index #0 don't match, which is 0.603345 from 3.62007
1: Google Test trace:
1: /home/zhukov/clients/rbx/onnxruntime/onnxruntime/test/common/tensor_op_test_utils.cc:14: ORT test random seed: 2900955797
1: [ FAILED ] XnnpackEP.TestConvTranspose_qdq (28 ms)
```

### Visual Studio Version

_No response_

### GCC / Compiler Version

gcc version 11.3.0 (Ubuntu 11.3.0-1ubuntu1~22.04)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.