apache / apache/gravitino

[EPIC] support cloud storage for spark hive connector

Open
#5,063 0 comments 0 reactions 0 assignees View on GitHub
epic
Dominant language
Java
Stars
3.2k
Forks
935
Avg merge
1d 17h
Merged PRs (30d)
339

Description

### Describe the proposal

Spark hive connector are tested on HDFS only, we need to test more cloud storages: s3, gcs, oss, etc

### Task list

- [x] #5064

Contributor guide

Open the contributing guide

Research direction

Review the completed #5064 task and the existing HDFS-only Spark Hive connector tests first. Define the remaining scope for S3, GCS, and OSS coverage, then verify that the connector tests run successfully against each supported cloud storage.

Written by the indexing model from the issue text.

Assessment

Tech stack
spark
Domain
cloud, data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.