alibaba / alibaba/DataX

clickhouse插入失败但是datax日志显示成功

Open
#1,186 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

由于插入partition过多导致数据插入失败,clickhouse本身有错误日志,datax未能处理此异常.
clickhouse版本:21.3.8.76
clickhouse jdbc driver版本:0.3.1
datax从当前master分支编译

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the ClickHouse insertion failure with version 21.3.8.76, JDBC driver 0.3.1, and DataX built from master, then trace how the ClickHouse writer handles errors when too many partitions are inserted. Done means the DataX log reports the insertion failure instead of reporting success.

Written by the indexing model from the issue text.

Assessment

Tech stack
clickhouse, java
Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.