alibaba / alibaba/DataX

DataX TxtFileWriter:fileFormat = csv生成的txt文件存在特殊字符未被包裹“”

Open
#652 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

1、dataX抽取oracle数据库的表,存在Clob字段含有换行符等特殊字符,该字段在写成txtfiles时,没有使用""包裹起来,导致txtfiles文件错列
2、dataX抽取oracle数据库的表,存在Raw字段,该字段在写成txtfiles时,被转义为16进制的字符,造成乱码,txtfiles数据无法使用

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the TxtFileWriter CSV path and reproduce both cases using Oracle CLOB and RAW columns. Done means CSV output keeps rows aligned by quoting embedded special characters and preserves RAW values in a usable form; verify the resulting txtfiles against representative source data.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.