alibaba / alibaba/DataX

(hdfs2oracle,error when the record include [“])hdfs2oracle,数据中包含英文引号报错

Open
#1,348 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

when hive2oracle,if the record include [“],datax will not split the data after ["]。the all data after ["] will become a big big big record。at last wrong(can bind a LONG value only for insert into a LONG column)

当hive2oracle是,如果字段值中包含英文的双引号,datax会吧后续的所有数据作为一个字段,导致后面不在切分。最后报错can bind a LONG value only for insert into a LONG column。

Contributor guide

No contributing guide indexed for this repository

Research direction

Start from the hdfs2oracle/hive2oracle transfer path and reproduce a row containing an English double quote. Trace where the record stops splitting and compare the parsed fields with the expected columns; done means quoted data no longer becomes one oversized field and the reported Oracle LONG-binding error is absent.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.