apache / apache/gravitino

[Subtask] Support S3 FilesystemCatalog backend for paimon spark3.3, spark3.4 and spark3.5

Open
#5,856 0 comments 0 reactions 0 assignees View on GitHub
subtask
Dominant language
Java
Stars
3.2k
Forks
935
Avg merge
1d 16h
Merged PRs (30d)
298

Description

### Describe the subtask

Support S3 FilesystemCatalog backend for paimon spark3.3, spark3.4 and spark3.5

### Parent issue

https://github.com/apache/gravitino/pull/5722

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the parent pull request linked in the issue, then trace how the Paimon FilesystemCatalog backend is integrated for Spark 3.3, 3.4, and 3.5. Done means S3 FilesystemCatalog support is available and verified across all three Spark versions.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, java, spark
Domain
backend, data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.