alibaba / alibaba/DataX

文本读取,unstructured-storage-util工具类中的BUG

Open
#240 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

问题:
在txtFileReader中
配置csvReaderConfig不生效

排查:
public static HashMap csvReaderConfigMap; 仅定义未赋值

在执行时可以通过readerSliceConfig.getMapConfiguration(Key.CSV_READER_CONFIG)获取到配置。但是未进行赋值就进行了判断。

解决:
在readFromStream和获取配置时加上即可
if(null == UnstructuredStorageReaderUtil.csvReaderConfigMap){
UnstructuredStorageReaderUtil.csvReaderConfigMap = (HashMap)readerSliceConfig.getMapConfiguration(Key.CSV_READER_CONFIG);
}

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in UnstructuredStorageReaderUtil and inspect txtFileReader, especially readFromStream and the CSV configuration lookup. Reproduce the issue with a csvReaderConfig setting, then verify that the configured values are assigned and take effect during text reading.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.