[VL] feat: Support extra schemes for hdfs filesystem
Open
enhancement
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 21h
- Merged PRs (30d)
- 85
Description
### Description
Currently we have supported jvm-based libhdfs, which means we can access any file system that implements hadoop FileSystem through its java client, like: `s3:// `, `rbf://`, `customFs://`, etc.
### Gluten version
main branch
Contributor guide
Research direction
The issue names no files, tests, or entry points. Start by locating the libhdfs filesystem scheme handling in the Gluten codebase and review how Hadoop FileSystem schemes are registered; done means extra schemes such as s3://, rbf://, and customFs:// are supported through the JVM-based client.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala
- Domain
- distributed-systems
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100