apache / apache/arrow

[Python] pyarrow does not disable SIMD CPU optimizations when set to do so.

Open
#34,277 26 comments 0 reactions 0 assignees View on GitHub
Component: Python Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 20h
Merged PRs (30d)
94

Description

### Describe the bug, including details regarding any error messages, version, and platform.

pyarrow exits immediately on my server with illegal instruction after running
python
import pyarrow

It does this even when setting the environment variable ARROW_USER_SIMD_LEVEL to NONE.

This problem has been reported by several users and occurs on a few of my systems.

### Component(s)

Python

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the reported `python` followed by `import pyarrow` failure with `ARROW_USER_SIMD_LEVEL=NONE` on an affected system. Trace how the Python component reads that setting and how SIMD initialization responds; done means importing pyarrow no longer exits with an illegal-instruction error when SIMD is disabled.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, python
Domain
performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.