An overwrite option for all sink types that write to HDFS
未关闭
enhancement
- 主要语言
- Scala
- 星标
- 147
- 派生
- 32
- PR 合并指标
- 30 天内没有已合并 PR
描述
An overwrite option for all sink types that write to HDFS
**Proposal**
Sink.withOverwrite
**AffectedSinks**
- Parquet
- AvroParquet
- Avro
- Orc
- Csv
贡献指南
这个仓库没有索引到贡献指南
调研方向
Look for sink implementations (Parquet, AvroParquet, Avro, Orc, Csv) in the codebase, likely under a 'sink' or 'io' package. Understand how they currently write to HDFS and where configuration options are handled. The goal is to add a 'withOverwrite' method that sets a flag to overwrite existing output files. Check existing tests for sinks to see how to add a test for the new option.
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- hadoop, scala
- 领域
- backend, data-engineering
- Issue 类型
- 功能
- 难度
- 3/5
- 预计耗时
- 1-2 天
- 活跃度
- 停滞
- 描述清晰度
- 基本清楚
- 新手友好度
- 45/100