apache / apache/gluten

Use environment variables to specify the local package path in CI

Open
#5,118 2 comments 3 reactions 1 assignee Claimed by @philo-he View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 21h
Merged PRs (30d)
85

Description

### Description

Due to network issues, packages like Arrow and Thrift often fail to download. Since https://github.com/facebookincubator/velox/pull/4325 already supports specifying the local package path through environment variables, the corresponding packages can be downloaded into the Docker image and used locally through environment variables. This approach can help avoid CI failures caused by unsuccessful package downloads.

For example.
```
export ARROW_THRIFT_URL=/mnt/disk1/thirdparty/thrift-0.16.0.tar.gz
export ARROW_GTEST_URL=/mnt/disk1/thirdparty/googletest-release-1.11.0.tar.gz
export ARROW_RAPIDJSON_URL=/mnt/disk1/thirdparty/rapidjson-232389d4f1012dddec4ef84861face2d2ba85709.tar.gz
export VELOX_CPR_URL=/mnt/disk1/thirdparty/cpr-1.10.5.tar.gz
export VELOX_ARROW_URL=/mnt/disk1/thirdparty/apache-arrow-15.0.0.tar.gz
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.