apache / apache/gluten

[VL] Remove the libhdfs3 installation script required for static linking

Open
#8,020 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Description

We will only retain the dynamic libraries libhdfs.so or libhdfs3.so at runtime based on this benchmark https://github.com/apache/incubator-gluten/issues/7746#issuecomment-2482406467. So there is no need to keep the libhdfs3 installation script required for static linking.

Contributor guide

Open the contributing guide

Research direction

Locate the libhdfs3 installation script used for static linking and read its build references. Confirm that runtime support only needs the dynamic libhdfs.so or libhdfs3.so libraries, then remove the obsolete installation path and update any references. No test or file path is named, so verify the build still works without the script.

Written by the indexing model from the issue text.

Assessment

Tech stack
hadoop
Domain
build-system
Issue type
Refactor
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.