alibaba / alibaba/DataX

本地部署没有问题,部署到服务器报错ClassNotFoundException: com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Job

Open
#2,066 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

项目中新引入了doriswriter, 在本地调试成功后,部署服务器运行报错
at com.alibaba.datax.core.Engine.start(Engine.java:92) [datax-core-1.0.1.jar:na]
at com.alibaba.datax.core.Engine.entry(Engine.java:171) [datax-core-1.0.1.jar:na]
at com.alibaba.datax.core.Engine.main(Engine.java:210) [datax-core-1.0.1.jar:na]
Caused by: java.lang.ClassNotFoundException: com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Job
at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[na:1.8.0_202]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[na:1.8.0_202]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[na:1.8.0_202]
at com.alibaba.datax.core.util.container.LoadUtil.loadPluginClass(LoadUtil.java:173) ~[datax-core-1.0.1.jar:na]
... 7 common frames omitted
2024-03-06 10:26:22.547 [job-0] INFO StandAloneJobContainerCommunicator - Total 0 records, 0 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 0.00%
2024-03-06 10:26:22.548 [job-0] ERROR Engine -

经DataX智能分析,该任务最可能的错误原因是:
com.alibaba.datax.common.exception.DataXException: Code:[Framework-02], Description:[DataX引擎运行过程出错,具体原因请参看DataX运行结束时的错误诊断信息 .]. - java.lang.ClassNotFoundException: com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Job
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.alibaba.datax.core.util.container.LoadUtil.loadPluginClass(LoadUtil.java:173)
at com.alibaba.datax.core.util.container.LoadUtil.loadJobPlugin(LoadUtil.java:93)
at com.alibaba.datax.core.job.JobContainer.initJobWriter(JobContainer.java:691)
at com.alibaba.datax.core.job.JobContainer.init(JobContainer.java:304)
at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:113)
at com.alibaba.datax.core.Engine.start(Engine.java:92)
at com.alibaba.datax.core.Engine.entry(Engine.java:171)
at com.alibaba.datax.core.Engine.main(Engine.java:210)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with LoadUtil.loadPluginClass and loadJobPlugin, then compare the local and server deployment artifacts and classpaths to verify whether DorisWriter$Job is included. Done means the deployed server can load com.alibaba.datax.plugin.writer.doriswriter.DorisWriter$Job and run the job without ClassNotFoundException.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend, devops
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.