Error during the building of Apache Arrow (Build Gluten with Velox Backend)
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
### Problem description
I tried to build Gluten with Velox backend as described in the documentation and eventually got an error:
```
+ compile_arrow_java_module
+ ARROW_HOME=/root/gluten/ep/build-velox/src/../build/velox_ep/_build/release/third_party/arrow_ep/src/arrow_ep
+ ARROW_INSTALL_DIR=/root/gluten/ep/build-velox/src/../build/velox_ep/_build/release/third_party/arrow_ep/src/arrow_ep/../../install
+ pushd /root/gluten/ep/build-velox/src/../build/velox_ep/_build/release/third_party/arrow_ep/src/arrow_ep/java
~/gluten/ep/build-velox/build/velox_ep/_build/release/third_party/arrow_ep/src/arrow_ep/java ~/gluten/ep/build-velox/build/velox_ep/_build/release/_deps
+ mvn generate-resources -P generate-libs-cdata-all-os -Darrow.c.jni.dist.dir=/root/gluten/ep/build-velox/src/../build/velox_ep/_build/release/third_party/arrow_ep/src/arrow_ep/../../install -N
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Detecting the operating system and CPU architecture
[INFO] ------------------------------------------------------------------------
[INFO] os.detected.name: linux
[INFO] os.detected.arch: x86_64
[INFO] os.detected.bitness: 64
[INFO] os.detected.version: 5.4
[INFO] os.detected.version.major: 5
[INFO] os.detected.version.minor: 4
[INFO] os.detected.release: ubuntu
[INFO] os.detected.release.version: 22.04
[INFO] os.detected.release.like.ubuntu: true
[INFO] os.detected.release.like.debian: true
[INFO] os.detected.classifier: linux-x86_64
[INFO]
[INFO] ------------------< org.apache.arrow:arrow-java-root >------------------
[INFO] Building Apache Arrow Java Root POM 15.0.0
[INFO] from pom.xml
[INFO] --------------------------------[ pom ]---------------------------------
[WARNING] The POM for org.apache.arrow.maven.plugins:module-info-compiler-maven-plugin:jar:15.0.0 is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 0.602 s
[INFO] Finished at: 2024-02-13T21:29:34Z
[INFO] ------------------------------------------------------------------------
[ERROR] Plugin org.apache.arrow.maven.plugins:module-info-compiler-maven-plugin:15.0.0 or one of its dependencies could not be resolved: The following artifacts could not be resolved: org.apache.arrow.maven.plugins:module-info-compiler-maven-plugin:jar:15.0.0 (absent): org.apache.arrow.maven.plugins:module-info-compiler-maven-plugin:jar:15.0.0 was not found in https://repo.maven.apache.org/maven2 during a previous attempt. This failure was cached in the local repository and resolution is not reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
```
I used a clean docker image with ubuntu:22.04. The exact set of used commands is shown below:
```
docker run --rm -it ubuntu:22.04
apt-get update
apt-get -y install curl unzip zip git build-essential autoconf pkg-config bison libtool libtool-bin python3 autoconf-archive flex sudo cmake
# java
curl -s "https://get.sdkman.io" | bash
source "/root/.sdkman/bin/sdkman-init.sh"
sdk install java 8.0.402-tem
sdk install maven
export JAVA_HOME=/root/.sdkman/candidates/java/current
export PATH=$JAVA_HOME/bin:$PATH
git clone https://github.com/oap-project/gluten.git
cd gluten
./dev/buildbundle-veloxbe.sh --enable_s3=ON --enable_vcpkg=ON --compile_arrow_java=ON
```
### System information
Velox System Info v0.0.2
Commit: e8342dde475314cfc9877cc0b45ea08b5ef8ad5d
CMake Version: 3.22.1
System: Linux-5.4.0-1080-aws
Arch: x86_64
C++ Compiler: /usr/bin/c++
C++ Compiler Version: 11.4.0
C Compiler: /usr/bin/cc
C Compiler Version: 11.4.0
CMake Prefix Path: /usr/local;/usr;/;/usr;/usr/local;/usr/X11R6;/usr/pkg;/opt
### CMake log
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.