alibaba / alibaba/DataX

hdfswriter不支持一次写入多个分区

Open
#641 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

我有一个hive分区表按pt_day字段分区,源数据中需要向多个分区写入。但是目前仅支持单分区写入,请问有没有解决方案?

Contributor guide

No contributing guide indexed for this repository

Research direction

No file, test, or concrete entry point is named. Start by locating the HDFS writer and its partition-writing path, then reproduce the single-partition limitation with a Hive table partitioned by pt_day. Done means documenting or implementing a confirmed way to write source data into multiple partitions.

Written by the indexing model from the issue text.

Assessment

Tech stack
hadoop, java
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.