apache / apache/gluten

Build failures when building Apache Gluten with Velox on Azure Arm64 (Ubuntu 24.04)

Open
#11,633 3 comments 0 reactions 0 assignees View on GitHub
triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Problem description

@acvictor I am trying to build **Apache Gluten with Velox backend on Arm64 (aarch64) using an Azure Arm-based VM**. During the build process, I consistently encounter two failures:

1. **Velox compilation** fails with `cc1plus` being killed while compiling `MaxByAggregate.cpp`
2. **fbthrift installation** fails because `libthriftcpp2.a` is not generated/found

Both issues occur while building Gluten + Velox on Arm64 and block the build completely.

### System information

**Cloud provider:** Microsoft Azure
**Region:** Central India

**Virtual Machine**
**VM Size:** Standard D4ps v6
**vCPUs / Memory:** 4 vCPUs, 16 GiB RAM
**Architecture**: Arm64 (aarch64)
**CPU**: ARM Neoverse (Azure Arm-based processor)

**Operating System**
**OS:** Ubuntu 24.04 LTS

**Kernel:** Linux 5.15.x
**Toolchain**
**CMake:** 3.28.x
**C/C++ Compiler:** GCC 9.4.0
**Build system:** Ninja
**ccache**: Enabled

### CMake log

```bash
Error 1: Velox build fails (cc1plus killed)

This is the first failure observed during the Velox build.

[1402/2758] Building CXX object velox/buffer/CMakeFiles/velox.dir/__/functions/prestosql/aggregates/MaxByAggregate.cpp.o
FAILED: velox/buffer/CMakeFiles/velox.dir/__/functions/prestosql/aggregates/MaxByAggregate.cpp.o

/usr/bin/ccache /usr/bin/c++ ... -mcpu=neoverse-n2 -O3 -std=gnu++20 ...
-c /home/azureuser/velox/velox/functions/prestosql/aggregates/MaxByAggregate.cpp

c++: fatal error: Killed signal terminated program cc1plus
compilation terminated.

ninja: build stopped: subcommand failed.

Error 2: fbthrift install fails (libthriftcpp2.a missing)

After partial progress, the build fails again during fbthrift installation.

-- Installing: /usr/local/lib/libthriftanyrep.a
-- Installing: /usr/local/lib/libthriftprotocol.a

CMake Error at _build/thrift/lib/cpp2/cmake_install.cmake:113 (file):
file INSTALL cannot find
"/home/azureuser/incubator-gluten/ep/build-velox/build/velox_ep/fbthrift/_build/lib/libthriftcpp2.a":
No such file or directory.

Call Stack (most recent call first):
_build/thrift/lib/cmake_install.cmake:77 (include)
_build/thrift/cmake_install.cmake:90 (include)
_build/cmake_install.cmake:51 (include)

Failed to run install_fbthrift.
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.