DTStack / DTStack/Taier

Flink-1.12-standalone模式下执行Flink任务执行失败,从hdfs下载文件到本地不成功(HdfsFileManage.java)

Open
#1,036 0 comments 0 reactions 0 assignees View on GitHub
question
Dominant language
Java
Stars
1.3k
Forks
350
PR merge metrics
No merged PRs in 30d

Description

### Search before asking

- [ ] I had searched in the [issues](https://github.com/DTStack/Taier/issues) and found no similar question.

- [ ] I had searched my question on the internet but i didn't get any help.

- [ ] I had read the documentation: [Taier doc](https://dtstack.github.io/Taier) but it didn't help me.

### Description

====================基本日志====================
[17:26:40] 2023-04-07 17:26:37:com.dtstack.taier.pluginapi.exception.PluginDefineException: 4l99983ituv0 failed
com.dtstack.taier.pluginapi.exception.PluginDefineException: 4l99983ituv0 failed
at com.dtstack.taier.flink.FlinkClient.beforeSubmitFunc(FlinkClient.java:225)
at com.dtstack.taier.pluginapi.client.AbstractClient.submitJob(AbstractClient.java:58)
at com.dtstack.taier.common.client.ClientProxy$2.execute(ClientProxy.java:103)
at com.dtstack.taier.common.client.ClientProxy$2.execute(ClientProxy.java:99)
at com.dtstack.taier.pluginapi.callback.ClassLoaderCallBackMethod.callbackAndReset(ClassLoaderCallBackMethod.java:31)
at com.dtstack.taier.common.client.ClientProxy.lambda$submitJob$1(ClientProxy.java:99)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.RuntimeException: File does not exist: /taier/tmp/4l99983ituv0_7265/jar/1_flink_cdc_sqlserver-1.0-SNAPSHOT.jar
at com.dtstack.taier.base.filesystem.FilesystemManager.getLocalJarFile(FilesystemManager.java:163)
at com.dtstack.taier.base.filesystem.FilesystemManager.downloadFile(FilesystemManager.java:121)
at com.dtstack.taier.base.filesystem.FilesystemManager.downloadFile(FilesystemManager.java:82)
at com.dtstack.taier.flink.util.FlinkUtil.downloadJar(FlinkUtil.java:199)
at com.dtstack.taier.flink.FlinkClient.beforeSubmitFunc(FlinkClient.java:221)
... 9 more

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
从hdfs下载文件到本地不成功(HdfsFileManage.java)
com.dtstack.taier.pluginapi.exception.PluginDefineException: 4lah1ek0qne0 failed
at com.dtstack.taier.flink.FlinkClient.beforeSubmitFunc(FlinkClient.java:231)
at com.dtstack.taier.pluginapi.client.AbstractClient.submitJob(AbstractClient.java:58)
at com.dtstack.taier.common.client.ClientProxy$2.execute(ClientProxy.java:103)
at com.dtstack.taier.common.client.ClientProxy$2.execute(ClientProxy.java:99)
at com.dtstack.taier.pluginapi.callback.ClassLoaderCallBackMethod.callbackAndReset(ClassLoaderCallBackMethod.java:31)
at com.dtstack.taier.common.client.ClientProxy.lambda$submitJob$1(ClientProxy.java:99)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.RuntimeException: Wrong FS: hdfs://**********/taier/1****.jar, expected: file:///
at com.dtstack.taier.base.filesystem.manager.HdfsFileManage.downloadFile(HdfsFileManage.java:83)
at com.dtstack.taier.base.filesystem.FilesystemManager.downloadFile(FilesystemManager.java:114)
at com.dtstack.taier.base.filesystem.FilesystemManager.downloadFile(FilesystemManager.java:82)
at com.dtstack.taier.flink.util.FlinkUtil.downloadJar(FlinkUtil.java:199)
at com.dtstack.taier.flink.FlinkClient.beforeSubmitFunc(FlinkClient.java:227)
... 9 more

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.