apache / apache/arrow

[Python] Unable to build pyarrow wheels with manylinux2014 for ppc64le arch

Open
#30,945 3 comments 0 reactions 0 assignees View on GitHub
Component: Python installation Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

Hi, I'm trying to build wheels for ppc64le with manylinux2014 following the [documentation](https://arrow.apache.org/docs/developers/python.html#building-on-linux-and-macos) but when I'm executing the cmake command I'm getting this issue:
```java

[...]

cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
-DCMAKE_INSTALL_LIBDIR=lib \
-DARROW_WITH_BZ2=ON \
-DARROW_WITH_ZLIB=ON \
-DARROW_WITH_ZSTD=ON \
-DARROW_WITH_LZ4=ON \
-DARROW_WITH_SNAPPY=ON \
-DARROW_WITH_BROTLI=ON \
-DARROW_PARQUET=ON \
-DARROW_PYTHON=ON \
-DARROW_BUILD_TESTS=ON \
-DPython3_EXECUTABLE=/opt/python/cp37-cp37m/bin/python3 \
..

[...]

– Creating bundled static library target arrow_bundled_dependencies at /repos/arrow/cpp/build/release/libarrow_bundled_dependencies.a
CMake Error at /opt/_internal/pipx/venvs/cmake/lib/python3.9/site-packages/cmake/data/share/cmake-3.22/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
  Could NOT find Python3 (missing: Development NumPy Development.Module
  Development.Embed) (found version "3.7.12")
Call Stack (most recent call first):
  /opt/_internal/pipx/venvs/cmake/lib/python3.9/site-packages/cmake/data/share/cmake-3.22/Modules/FindPackageHandleStandardArgs.cmake:594 (_FPHSA_FAILURE_MESSAGE)
  /opt/_internal/pipx/venvs/cmake/lib/python3.9/site-packages/cmake/data/share/cmake-3.22/Modules/FindPython/Support.cmake:3166 (find_package_handle_standard_args)
  /opt/_internal/pipx/venvs/cmake/lib/python3.9/site-packages/cmake/data/share/cmake-3.22/Modules/FindPython3.cmake:490 (include)
  cmake_modules/FindPython3Alt.cmake:46 (find_package)
  src/arrow/python/CMakeLists.txt:22 (find_package)
```
 

Anyone knows what is going wrong here? I installed numpy via the requirements files.

**Reporter**: [Marvin Giessing](https://issues.apache.org/jira/browse/ARROW-15469)

**Note**: *This issue was originally created as [ARROW-15469](https://issues.apache.org/jira/browse/ARROW-15469). Please see the [migration documentation](https://github.com/apache/arrow/issues/14542) for further details.*

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the documented manylinux2014 ppc64le build and its CMake configure command with Python 3.7 and NumPy installed from the requirements files. Read cmake_modules/FindPython3Alt.cmake and src/arrow/python/CMakeLists.txt to trace the missing Python development components. Done means CMake configures successfully and the Python wheel build completes.

Written by the indexing model from the issue text.

Assessment

Tech stack
cmake, cpp, python
Domain
build-system
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.