oss抽取mysql数据写入oss报错未知
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
json配置文件为:
"writer": {
"name": "osswriter",
"parameter": {
"endpoint": "oss://aaa.aliyuncs.com",
"accessId": "",
"accessKey": "",
"bucket": "",
"object": "",
"encoding": "UTF-8",
"column": [
{"name":"id", "type": "string"}
],
"fileFormat": "text",
"path": "/user/aaa",
"fieldDelimiter": "\t",
"writeMode": "append"
}
}
2023-10-13 17:46:39.967 [job-0] ERROR JobContainer - Exception when job run
com.alibaba.datax.common.exception.DataXException: Code:[OssWriter-05], Description:[执行相应的OSS操作异常.]. - Unknown
at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:26) ~[datax-common-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.plugin.writer.osswriter.OssWriter$Job.prepare(OssWriter.java:164) ~[osswriter-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.job.JobContainer.prepareJobWriter(JobContainer.java:724) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.job.JobContainer.prepare(JobContainer.java:309) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:115) ~[datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.Engine.start(Engine.java:92) [datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.Engine.entry(Engine.java:171) [datax-core-0.0.1-SNAPSHOT.jar:na]
at com.alibaba.datax.core.Engine.main(Engine.java:204) [datax-core-0.0.1-SNAPSHOT.jar:na]
2023-10-13 17:46:39.971 [job-0] INFO StandAloneJobContainerCommunicator - Total 0 records, 0 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 0.00%
2023-10-13 17:46:39.972 [job-0] ERROR Engine -
经DataX智能分析,该任务最可能的错误原因是:
com.alibaba.datax.common.exception.DataXException: Code:[OssWriter-05], Description:[执行相应的OSS操作异常.]. - Unknown
at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:26)
at com.alibaba.datax.plugin.writer.osswriter.OssWriter$Job.prepare(OssWriter.java:164)
at com.alibaba.datax.core.job.JobContainer.prepareJobWriter(JobContainer.java:724)
at com.alibaba.datax.core.job.JobContainer.prepare(JobContainer.java:309)
at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:115)
at com.alibaba.datax.core.Engine.start(Engine.java:92)
at com.alibaba.datax.core.Engine.entry(Engine.java:171)
at com.alibaba.datax.core.Engine.main(Engine.java:204)
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the OSS writer configuration in the issue and com.alibaba.datax.plugin.writer.osswriter.OssWriter.java at line 164, where the stack trace reports the failure. Reproduce the job with the supplied settings and inspect the underlying OSS operation; done should include a confirmed cause and a clearly reported resolution, but the issue does not define the expected change.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, mysql
- Domain
- backend, cloud
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100