alibaba / alibaba/DataX

txtfilereader读插件关于分隔符只支持一位长度,能否支持多位

Open
#2,357 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

txtfilereader读插件关于fieldDelimiter参数能否支持多位分隔符情况,如下代码能否修改:
String delimiterInStr = this.originConfig.getString(com.alibaba.datax.plugin.unstructuredstorage.reader.Key.FIELD_DELIMITER);
// warn: if have, length must be one
if (null != delimiterInStr && 1 != delimiterInStr.length()) {
throw DataXException.asDataXException(
UnstructuredStorageReaderErrorCode.ILLEGAL_VALUE,
String.format("仅仅支持单字符切分, 您配置的切分为 : [%s]",
delimiterInStr));
}

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in the txtfilereader plugin at the handling of Key.FIELD_DELIMITER, beginning with the shown originConfig validation. Trace how the delimiter is consumed after validation and run the relevant reader tests if available. Done means multi-character delimiters are accepted and existing single-character behavior remains intact.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
65/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.