apache / apache/gluten

[VL] Adding intergration tests for S3/HDFS/GCS/ABFS

Open
#9,184 11 comments 0 reactions 0 assignees View on GitHub
enhancement good first issue
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 21h
Merged PRs (30d)
85

Description

### Description

Currently there are only build checks for these in GHA, better to add some basic integration tests also.

Subtasks:
- https://github.com/apache/incubator-gluten/issues/9618

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the existing GHA build checks for S3, HDFS, GCS, and ABFS and the linked subtask in issue #9618. Determine how the project provisions or accesses each backend, then add basic integration coverage for the four storage systems and verify the tests run successfully in GHA.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, azure, gcp
Domain
cloud, testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.