apache / apache/gravitino

[Subtask] Support write s3 fileset in Daft io

Open
#9,263 0 comments 0 reactions 0 assignees View on GitHub
subtask
Dominant language
Java
Stars
3.2k
Forks
935
Avg merge
1d 16h
Merged PRs (30d)
298

Description

### Describe the subtask

As titled, Gravitino fileset catalog supports multiple storages (s3, azure, gcs, hdfs). This issue is to support s3 fileset catalog writting (with gvfs) in Daft io.

### Parent issue

https://github.com/apache/gravitino/issues/9259

Contributor guide

Open the contributing guide

Research direction

Start with parent issue #9259 and the existing Daft IO/GVFS fileset support. Trace how the other listed storage backends handle fileset writes, then verify that writing an S3-backed fileset through Daft IO works correctly.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
cloud, data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.