alibaba / alibaba/DataX

oss抽取mysql数据写入oss报错未知

Open
#1,957 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

json配置文件为:
"writer": {
"name": "osswriter",
"parameter": {
"endpoint": "oss://aaa.aliyuncs.com",
"accessId": "",
"accessKey": "",
"bucket": "",
"object": "",
"encoding": "UTF-8",
"column": [
{"name":"id", "type": "string"}
],
"fileFormat": "text",
"path": "/user/aaa",
"fieldDelimiter": "\t",
"writeMode": "append"
}
}

2023-10-13 17:46:39.967 [job-0] ERROR JobContainer - Exception when job run
com.alibaba.datax.common.exception.DataXException: Code:[OssWriter-05], Description:[执行相应的OSS操作异常.]. - Unknown
at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:26) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.osswriter.OssWriter$Job.prepare(OssWriter.java:164) ~[osswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.job.JobContainer.prepareJobWriter(JobContainer.java:724) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.job.JobContainer.prepare(JobContainer.java:309) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:115) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.Engine.start(Engine.java:92) [datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.Engine.entry(Engine.java:171) [datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.Engine.main(Engine.java:204) [datax-core-0.0.1-SNAPSHOT.jar:na]
2023-10-13 17:46:39.971 [job-0] INFO StandAloneJobContainerCommunicator - Total 0 records, 0 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 0.00%
2023-10-13 17:46:39.972 [job-0] ERROR Engine -

经DataX智能分析,该任务最可能的错误原因是:
com.alibaba.datax.common.exception.DataXException: Code:[OssWriter-05], Description:[执行相应的OSS操作异常.]. - Unknown
at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:26)
at com.alibaba.datax.plugin.writer.osswriter.OssWriter$Job.prepare(OssWriter.java:164)
at com.alibaba.datax.core.job.JobContainer.prepareJobWriter(JobContainer.java:724)
at com.alibaba.datax.core.job.JobContainer.prepare(JobContainer.java:309)
at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:115)
at com.alibaba.datax.core.Engine.start(Engine.java:92)
at com.alibaba.datax.core.Engine.entry(Engine.java:171)
at com.alibaba.datax.core.Engine.main(Engine.java:204)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the OSS writer configuration in the issue and com.alibaba.datax.plugin.writer.osswriter.OssWriter.java at line 164, where the stack trace reports the failure. Reproduce the job with the supplied settings and inspect the underlying OSS operation; done should include a confirmed cause and a clearly reported resolution, but the issue does not define the expected change.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
backend, cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.