apache / apache/dolphinscheduler

[Improvement][K8s] too old resource version

Open
#17,330 1 comment 0 reactions 1 assignee Claimed by @det101 View on GitHub
help wanted improvement
Dominant language
Java
Stars
14.5k
Forks
5.1k
Avg merge
1d 21h
Merged PRs (30d)
29

Description

### Search before asking

- [x] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement.

### Description

I use the K8s plugin to complete job,but if the job takes a long time ,it will cause the problem. Here is the log:
[LOG-PATH]: /data/tsf/dolphinscheduler/worker-server/logs/20250709/18098005626112_15-3763-56288.log, [HOST]: Host{address='11.157.0.108:1234', ip='11.157.0.108', port=1234}

[INFO] 2025-07-09 09:46:46.094 +0800 - Begin to pulling task

[INFO] 2025-07-09 09:46:46.094 +0800 - Begin to initialize task

[INFO] 2025-07-09 09:46:46.094 +0800 - Set task startTime: Wed Jul 09 09:46:46 GMT+08:00 2025

[INFO] 2025-07-09 09:46:46.094 +0800 - Set task envFile: /data/tsf/dolphinscheduler/worker-server/conf/dolphinscheduler_env.sh

[INFO] 2025-07-09 09:46:46.095 +0800 - Set task appId: 3763_56288

[INFO] 2025-07-09 09:46:46.095 +0800 - End initialize task

[INFO] 2025-07-09 09:46:46.095 +0800 - Set task status to TaskExecutionStatus{code=1, desc='running'}

[INFO] 2025-07-09 09:46:46.095 +0800 - TenantCode:tencent check success

[INFO] 2025-07-09 09:46:46.095 +0800 - ProcessExecDir:/tmp/dolphinscheduler/exec/process/tencent/17858597217280/18098005626112_15/3763/56288 check success

[INFO] 2025-07-09 09:46:46.095 +0800 - Resources:{} check success

[INFO] 2025-07-09 09:46:46.095 +0800 - Task plugin: K8S create success

[INFO] 2025-07-09 09:46:46.095 +0800 - Success initialized task plugin instance success

[INFO] 2025-07-09 09:46:46.095 +0800 - Success set taskVarPool: null

[INFO] 2025-07-09 09:46:46.098 +0800 - [K8sJobExecutor-sr-sql-1-56288] start to submit job

[INFO] 2025-07-09 09:46:52.031 +0800 - [K8sJobExecutor-sr-sql-1-56288] submitted job successfully

[ERROR] 2025-07-09 10:19:01.458 +0800 - [K8sJobExecutor-sr-sql-1-56288] fail in k8s: too old resource version: 44517703052 (44517715422)

[INFO] 2025-07-09 10:19:01.460 +0800 - Send task execute result to master, the current task status: TaskExecutionStatus{code=6, desc='failure'}

[INFO] 2025-07-09 10:19:01.460 +0800 - Remove the current task execute context from worker cache

[INFO] 2025-07-09 10:19:01.460 +0800 - The current execute mode isn't develop mode, will clear the task execute file: /tmp/dolphinscheduler/exec/process/tencent/17858597217280/18098005626112_15/3763/56288

[INFO] 2025-07-09 10:19:01.460 +0800 - Success clear the task execute file: /tmp/dolphinscheduler/exec/process/tencent/17858597217280/18098005626112_15/3763/56288

### Are you willing to submit a PR?

- [ ] Yes I am willing to submit a PR!

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.