alibaba / alibaba/DataX

Datax生成job文本到ftp的模板错误

Open
#80 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

$ ./bin/datax.py -r txtfilereader -w ftpwriter
如下
{
"job": {
"content": [
{
"reader": {
"name": "txtfilereader",
"parameter": {
"column": [],
"encoding": "",
"fieldDelimiter": "",
"path": []
}
},
"writer": {
**"name": "ftpwriter",
"parameter": {
"name": "ftpwriter",
"parameter": {
"connectPattern": "",
"dateFormat": "",
"encoding": "",
"fieldDelimiter": "",
"fileFormat": "",
"fileName": "",
"header": [],
"host": "",
"nullFormat": "",
"password": "",
"path": "",
"port": "",
"protocol": "",
"timeout": "",
"username": "",
"writeMode": ""
}
}**
}
}
],
"setting": {
"speed": {
"channel": ""
}
}
}
}
多套用一层name和parameter。被误导了。

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the template-generation entry point in bin/datax.py and reproduce the command using txtfilereader and ftpwriter. Trace the writer template and remove the extra name and parameter nesting so the generated job matches the intended structure shown in the issue; verify the command output no longer contains that duplicated layer.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering, tooling
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.