Some pytest tests fail locally following docs
Open
@GregoryComer is already working on this.
Since Mar 10, 2026.
module: user experience
- Dominant language
- Python
- Stars
- 5k
- Forks
- 1.2k
- Avg merge
- 2d 10h
- Merged PRs (30d)
- 581
Description
🐛 Describe the bug
On Apple Silicon, there are some tests that fail or spit out warnings when following docs and running pytest -n auto. This is likely an env setup issue, but we should make sure that the tests are clean on a fresh install.
[method.cpp:74] Backend BackendWithCompilerDemo is not registered.
============================================================================================================== short test summary info ==============================================================================================================
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_fetch_execu_torch_data_failure - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_fetch_execu_torch_data_success - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_filter_out_failure_only - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_filter_private_results - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_filter_public_result - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_get_base_url - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_init - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_invalid_iso8601 - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_normalize_string - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_output_data - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_output_type_values - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_run_no_data - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_run_with_failure_report - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_run_with_filters - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_run_with_public_match - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_run_without_public_match - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_csv - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_df - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_dict - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_excel - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_json - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_output_type - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_valid_iso8601 - ModuleNotFoundError: No module named 'yaspin'
FAILED exir/backend/test/test_compatibility.py::TestCompatibility::test_compatibility_in_runtime - RuntimeError: Failed to execute method forward, error: 0x20
FAILED exir/backend/test/test_compatibility.py::TestCompatibility::test_compatibility_in_runtime_edge_program_manager - RuntimeError: Failed to execute method forward, error: 0x20
FAILED exir/backend/test/test_lowered_backend_module.py::TestBackendAPI::test_emit_lowered_backend_module_end_to_end - RuntimeError: Failed to execute method forward, error: 0x20
FAILED exir/backend/test/test_to_backend_multi_method.py::TestToBackendMultiMethod::test_multi_method_end_to_end - RuntimeError: Failed to execute method forward, error: 0x20
Versions
Nightly
cc @mergennachin @byjlw
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.