apache / apache/cloudstack

CKS upgrade fails in the following scenario

Đang mở
#14,148 1 bình luận 0 reaction 0 người được giao Được @Pearl1594 nhận Xem trên GitHub
bug component:kubernetes
Ngôn ngữ chính
Java
Star
3.1k
Fork
1.4k
Merge trung bình
6 ngày 19 giờ
Pull request đã merge (30 ngày)
32

Mô tả

### problem

CKS upgrade fails in the following scenario

### versions

ACS 4.22,423

### The steps to reproduce the bug

1. Register 2 cks iso ( 1.36 and 1.37)

2. Launch a cks cluster with 1.36

```
create kubernetescluster name=cks-npe zoneid=157cb8ca-1c40-4a1f-a737-8bddb1dcb2fd kubernetesversionid=e8d2b996-54c8-457a-9a54-985ebc46b332 networkid=f2d97bea-3e96-44bd-ae16-fd98d7ea8a8e controlnodes=1 size=2 nodeofferings[0].node=control nodeofferings[0].offering=bf332776-e6c1-43cb-922d-7de6bb5d38a7 nodeofferings[1].node=worker nodeofferings[1].offering=d7892a54-8604-44ab-8892-dcd1357571a0 hypervisor=KVM

```
3. Upgrade the cks cluster to 1.37

```
(localcloud) 🐱 > upgrade kubernetescluster id=8912cd8d-29bd-44de-b5fc-6965e607cc2f kubernetesversionid=ac8576c2-8ddd-4008-b604-ec804220578e
{
"account": "admin",
"accountid": "47dc9e4c-83f6-11f1-aed8-bc24112069f3",
"cmd": "org.apache.cloudstack.api.command.user.kubernetes.cluster.UpgradeKubernetesClusterCmd",
"completed": "2026-09-10T18:45:53+0000",
"created": "2026-09-10T18:45:53+0000",
"domainid": "c92b36a9-83f5-11f1-aed8-bc24112069f3",
"domainpath": "ROOT",
"jobid": "7067c3b9-0510-44dd-bf8e-903ac61ae330",
"jobprocstatus": 0,
"jobresult": {
"errorcode": 530,
"errortext": "Invalid service offering associated with Kubernetes cluster : cks-npe"
},
"jobresultcode": 530,
"jobresulttype": "object",
"jobstatus": 2,
"userid": "47dcda68-83f6-11f1-aed8-bc24112069f3"
}

```
Logs

```

🙈 Error: async API failed for job 7067c3b9-0510-44dd-bf8e-903ac61ae330


root@Cloudstack-423:/home/ubuntu# cat /var/log/cloudstack/management/management-server.log |grep -i "logid:7067c3b9"
2026-09-10 18:45:53,428 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl$5] (API-Job-Executor-59:[ctx-4251e64e, job-1747]) (logid:7067c3b9) Executing AsyncJob {"accountId":2,"cmd":"org.apache.cloudstack.api.command.user.kubernetes.cluster.UpgradeKubernetesClusterCmd","cmdInfo":"{\"expires\":\"2026-09-10T19:00:53Z\",\"sessionkey\":\"oMUOvbLNNYCXMWQFm7q2WsLWymA\",\"httpmethod\":\"POST\",\"ctxAccountId\":\"2\",\"uuid\":\"8912cd8d-29bd-44de-b5fc-6965e607cc2f\",\"cmdEventType\":\"KUBERNETES.CLUSTER.UPGRADE\",\"kubernetesversionid\":\"ac8576c2-8ddd-4008-b604-ec804220578e\",\"signatureversion\":\"3\",\"response\":\"json\",\"ctxUserId\":\"2\",\"ctxStartEventId\":\"10164\",\"id\":\"8912cd8d-29bd-44de-b5fc-6965e607cc2f\",\"ctxDetails\":\"{\\\"interface com.cloud.kubernetes.version.KubernetesSupportedVersion\\\":\\\"ac8576c2-8ddd-4008-b604-ec804220578e\\\",\\\"interface com.cloud.kubernetes.cluster.KubernetesCluster\\\":\\\"8912cd8d-29bd-44de-b5fc-6965e607cc2f\\\"}\"}","cmdVersion":0,"completeMsid":null,"created":null,"id":1747,"initMsid":206863092181491,"instanceId":null,"instanceType":"KubernetesCluster","lastPolled":null,"lastUpdated":null,"processStatus":0,"removed":null,"result":null,"resultCode":0,"status":"IN_PROGRESS","userId":2,"uuid":"7067c3b9-0510-44dd-bf8e-903ac61ae330"}
2026-09-10 18:45:53,455 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-59:[ctx-4251e64e, job-1747]) (logid:7067c3b9) Complete async job-1747, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Invalid service offering associated with Kubernetes cluster : cks-npe"}
2026-09-10 18:45:53,456 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-59:[ctx-4251e64e, job-1747]) (logid:7067c3b9) Publish async job-1747 complete on message bus
2026-09-10 18:45:53,456 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-59:[ctx-4251e64e, job-1747]) (logid:7067c3b9) Wake up jobs related to job-1747
2026-09-10 18:45:53,456 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-59:[ctx-4251e64e, job-1747]) (logid:7067c3b9) Update db status for job-1747
2026-09-10 18:45:53,457 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-59:[ctx-4251e64e, job-1747]) (logid:7067c3b9) Wake up jobs joined with job-1747 and disjoin all subjobs created from job- 1747
2026-09-10 18:45:53,466 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl$5] (API-Job-Executor-59:[ctx-4251e64e, job-1747]) (logid:7067c3b9) Done executing org.apache.cloudstack.api.command.user.kubernetes.cluster.UpgradeKubernetesClusterCmd for job-1747
2026-09-10 18:45:53,466 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-59:[ctx-4251e64e, job-1747]) (logid:7067c3b9) Remove job-1747 from job monitoring

````

Could you be related to https://github.com/apache/cloudstack/issues/14122

### What to do about it?

Upgrade of the cks cluster should succeed

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Hướng nghiên cứu

Start with the UpgradeKubernetesClusterCmd entry point and review the linked pull request #14138, then reproduce the upgrade using the documented create and upgrade commands. Trace the invalid service offering error shown in the management-server log; done means upgrading the 1.36 CKS cluster to 1.37 succeeds without error 530.

Do mô hình lập chỉ mục viết ra từ nội dung của issue.

Đánh giá

Công nghệ
java, kubernetes
Lĩnh vực
backend-api-design, cloud, infrastructure
Loại issue
Lỗi
Độ khó
4/5
Thời gian dự kiến
3-5 ngày
Mức độ hoạt động
Đình trệ
Độ rõ ràng
Đặc tả rõ ràng
Mức phù hợp với người mới
35/100

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.