apache / apache/gluten

[VL] Understanding the Role of builder_helper_functions.sh in Architecture Detection and AVX Impact

Open
#8,469 3 comments 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Backend

VL (Velox)

### Bug description

Hi @PHILO-HE , Team

Hello,

I need some help in understanding the purpose and usage of the file builder_helper_functions.sh, particularly from the perspective of CPU architecture.

Does this file play a role in detecting the underlying architecture and deciding the build process accordingly?
Specifically, I noticed that it includes checks for AVX. Could someone clarify the reasoning behind introducing AVX in this context?
Does enabling AVX have any significant impact on the performance of Gluten when running on an x86 machine?
Additionally, I reviewed the pull request where the changes related to AVX checks in builder_helper_functions.sh were introduced, but I couldn’t find clear answers or explanations there.

Could anyone provide insights into the purpose and importance of these changes and is there any affect in the build process or performance?

Thank you in advance for your help !!

### Spark version

None

### Spark configurations

_No response_

### System information

_No response_

### Relevant logs

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.