kubesphere / kubesphere/ks-devops
ks3.2.1-devops-controller Keep requesting an error
- Dominant language
- Go
- Stars
- 164
- Forks
- 140
- PR merge metrics
- No merged PRs in 30d
Description
### What is version of KubeSphere DevOps has the issue?
3.2.1
### How did you install the Kubernetes? Or what is the Kubernetes distribution?
Install using KK
### What happened?
Since the upgrade from 3.1.0 to 3.2.1, DevOPs-Controller has been interacting with Devops-Apiserver and reporting errors, resulting in a much longer pipeline build run time
### Relevant log output
```shell
I0301 06:39:24.920427 1 apiserver.go:301] 10.233.97.73 - "GET /v1alpha2/devops/slzx4j2k7/pipelines/sl-task/ HTTP/1.1" 500 80 16ms
E0301 06:39:25.814869 1 pure_request.go:92] {
"message" : "Pipeline sl-task-ops not found",
"code" : 404,
"errors" : [ ]
}
E0301 06:39:25.814894 1 pipeline.go:94] {
"message" : "Pipeline sl-task-ops not found",
"code" : 404,
"errors" : [ ]
}
E0301 06:39:25.814905 1 devops.go:901] {
"message" : "Pipeline sl-task-ops not found",
"code" : 404,
"errors" : [ ]
}
I0301 06:39:25.814920 1 apiserver.go:301] 10.233.96.58 - "GET /v1alpha2/devops/slzx4j2k7/pipelines/sl-task-ops/ HTTP/1.1" 500 84 6ms
E0301 06:39:27.417269 1 pure_request.go:92] {
"message" : "Pipeline sl-task-ops not found",
"code" : 404,
"errors" : [ ]
==================================================================
E0301 06:48:34.830085 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="member-adapter" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"member-adapter-48d8t"} "namespace"="slzx4j2k7"
E0301 06:48:34.934931 1 pipelinerun_controller.go:128] pipelinerun-controller "msg"="unable get PipelineRun data." "error"="not found resources" "Pipeline"="mall-trade-business" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"mall-trade-business-p88dr"} "namespace"="slzx4j2k7"
E0301 06:48:35.010925 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="mall-trade-business" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"mall-trade-business-p88dr"} "namespace"="slzx4j2k7"
E0301 06:48:35.110489 1 pipelinerun_controller.go:128] pipelinerun-controller "msg"="unable get PipelineRun data." "error"="not found resources" "Pipeline"="member-biz" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"member-biz-z49lp"} "namespace"="slzx4j2k7"
E0301 06:48:35.114085 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="member-biz" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"member-biz-z49lp"} "namespace"="slzx4j2k7"
E0301 06:48:35.117375 1 pipelinerun_controller.go:128] pipelinerun-controller "msg"="unable get PipelineRun data." "error"="not found resources" "Pipeline"="fe-main-app" "PipelineRun"={"Namespace":"alphallm76","Name":"fe-main-app-xcvfq"} "namespace"="alphallm76"
E0301 06:48:35.121127 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="fe-main-app" "PipelineRun"={"Namespace":"alphallm76","Name":"fe-main-app-xcvfq"} "namespace"="alphallm76"
E0301 06:48:35.123885 1 pipelinerun_controller.go:128] pipelinerun-controller "msg"="unable get PipelineRun data." "error"="not found resources" "Pipeline"="mall-trade-business" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"mall-trade-business-vqwzm"} "namespace"="slzx4j2k7"
E0301 06:48:35.126453 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="mall-trade-business" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"mall-trade-business-vqwzm"} "namespace"="slzx4j2k7"
I0301 06:48:35.129311 1 pipelinerun_synchronizer.go:85] pipelinerun-synchronizer "msg"="synchronized PipelineRun successfully" "Pipeline"={"Namespace":"slzx4j2k7","Name":"sl-task-center"}
E0301 06:48:35.208515 1 pipelinerun_controller.go:128] pipelinerun-controller "msg"="unable get PipelineRun data." "error"="not found resources" "Pipeline"="mall-consumer-bff" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"mall-consumer-bff-ghft4"} "namespace"="slzx4j2k7"
E0301 06:48:35.211904 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="mall-consumer-bff" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"mall-consumer-bff-ghft4"} "namespace"="slzx4j2k7"
E0301 06:48:35.510085 1 pipelinerun_controller.go:128] pipelinerun-controller "msg"="unable get PipelineRun data." "error"="not found resources" "Pipeline"="activity-console-app" "PipelineRun"={"Namespace":"alphallm76","Name":"activity-console-app-nmqgf"} "namespace"="alphallm76"
E0301 06:48:35.513644 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="activity-console-app" "PipelineRun"={"Namespace":"alphallm76","Name":"activity-console-app-nmqgf"} "namespace"="alphallm76"
E0301 06:48:35.710401 1 pipelinerun_controller.go:128] pipelinerun-controller "msg"="unable get PipelineRun data." "error"="not found resources" "Pipeline"="member-adapter" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"member-adapter-99xxf"} "namespace"="slzx4j2k7"
E0301 06:48:35.713700 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="member-adapter" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"member-adapter-99xxf"} "namespace"="slzx4j2k7"
E0301 06:48:35.716680 1 pipelinerun_controller.go:128] pipelinerun-controller "msg"="unable get PipelineRun data." "error"="not found resources" "Pipeline"="member-center-app" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"member-center-app-47568"} "namespace"="slzx4j2k7"
E0301 06:48:35.722368 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="member-center-app" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"member-center-app-47568"} "namespace"="slzx4j2k7"
E0301 06:48:35.810456 1 pipelinerun_controller.go:128] pipelinerun-controller "msg"="unable get PipelineRun data." "error"="not found resources" "Pipeline"="mall-order-domain" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"mall-order-domain-ktbvw"} "namespace"="slzx4j2k7"
E0301 06:48:35.814005 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="mall-order-domain" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"mall-order-domain-ktbvw"} "namespace"="slzx4j2k7"
E0301 06:48:35.816693 1 pipelinerun_controller.go:128] pipelinerun-controller "msg"="unable get PipelineRun data." "error"="not found resources" "Pipeline"="mall-consumer-bff" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"mall-consumer-bff-fnthr"} "namespace"="slzx4j2k7"
E0301 06:48:35.818958 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="mall-consumer-bff" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"mall-consumer-bff-fnthr"} "namespace"="slzx4j2k7"
E0301 06:48:35.821638 1 pipelinerun_controller.go:128] pipelinerun-controller "msg"="unable get PipelineRun data." "error"="not found resources" "Pipeline"="member-center-app" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"member-center-app-tphbl"} "namespace"="slzx4j2k7"
E0301 06:48:35.824147 1 pipelinerun_controller.go:145] pipelinerun-controller "msg"="unable to get PipelineRun nodes detail" "error"="not found resources" "Pipeline"="member-center-app" "PipelineRun"={"Namespace":"slzx4j2k7","Name":"member-center-app-tphbl"} "namespace"="slzx4j2k7"
I0301 06:48:35.831624 1 pipelinerun_synchronizer.go:85] pipelinerun-synchronizer "msg"="synchronized PipelineRun successfully" "Pipeline"={"Namespace":"alphallm76","Name":"mall-item-domain2"}
I0301 06:48:35.840390 1 pipelinerun_synchronizer.go:85] pipelinerun-synchronizer "msg"="synchronized PipelineRun successfully" "Pipeline"={"Namespace":"cherykj6wm","Name":"chery-coupon-app-service"}
I0301 06:48:35.919499 1 pipelinerun_synchronizer.go:85] pipelinerun-synchronizer "msg"="synchronized PipelineRun successfully" "Pipeline"={"Namespace":"cherykj6wm","Name":"chery-coupon-ops-application"}
```
### Additional information
_No response_
Contributor guide
Research direction
Start by tracing the requests and errors in pipelinerun_controller.go, pipelinerun_synchronizer.go, and the logged apiserver.go, pure_request.go, pipeline.go, and devops.go locations. Reproduce the 3.1.0-to-3.2.1 upgrade scenario and determine why missing Pipeline and PipelineRun resources are repeatedly requested; done means the errors no longer recur and pipeline build times return to normal.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go, kubernetes
- Domain
- devops
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100