apache / apache/doris-operator

Context deadline exceeded

未关闭
#246 1 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Go
星标
138
派生
72
平均合并
5 天 12 小时
30 天内合并 PR
3

描述

Hi,I deployed only one node doris-operator(version 1.6.0) in k8s,and sometimes doris-operator would restart,the error as below:

E0914 01:56:25.370009 1 leaderelection.go:330] error retrieving resource lock grass-roots-wannian/e1370669.selectdb.com: Get "https://10.68.0.1:443/apis/coordination.k8s.io/v1/namespaces/grass-roots-wannian/leases/e1370669.selectdb.com": context deadline exceeded
I0914 01:56:25.370168 1 leaderelection.go:283] failed to renew lease grass-roots-wannian/e1370669.selectdb.com: timed out waiting for the condition
2024-09-14T01:56:25Z INFO Stopping and waiting for non leader election runnables
2024-09-14T01:56:25Z INFO Stopping and waiting for leader election runnables
2024-09-14T01:56:25Z INFO Stopping and waiting for caches
2024-09-14T01:56:25Z INFO Stopping and waiting for webhooks
2024-09-14T01:56:25Z INFO Wait completed, proceeding to shutdown the manager
2024-09-14T01:56:25Z INFO Shutdown signal received, waiting for all workers to finish {"controller": "doriscluster", "controllerGroup": "doris.selectdb.com", "controllerKind": "DorisCluster"}
2024-09-14T01:56:25Z INFO All workers finished {"controller": "doriscluster", "controllerGroup": "doris.selectdb.com", "controllerKind": "DorisCluster"}
2024-09-14T01:56:25Z DEBUG events doris-operator-5bfbffc6fd-jkv87_80c6fd10-a3a6-460b-86c6-79a92d37009b stopped leading {"type": "Normal", "object": {"kind":"Lease","namespace":"grass-roots-wannian","name":"e1370669.selectdb.com","uid":"9370b444-e38a-44ff-8c77-6420d2e72243","apiVersion":"coordination.k8s.io/v1","resourceVersion":"12311346"}, "reason": "LeaderElection"}
2024-09-14T01:56:25Z ERROR setup problem running manager {"error": "leader election lost"}
main.main
/workspace/cmd/operator/main.go:155
runtime.main
/usr/local/go/src/runtime/proc.go:250

Would you please help me to check it,I have no idea,thanks!

贡献指南

这个仓库没有索引到贡献指南

调研方向

从 cmd/operator/main.go:155 开始,检查丢失 leader election 后显示的 shutdown 路径。重现或调查报告的 context deadline exceeded,并确定 single operator 重启的原因;完成的标准是记录原因,并提供经过验证的修复方案或明确的后续步骤。

由索引模型根据 Issue 内容生成。

评估

技术栈
go, kubernetes
领域
devops, infrastructure
Issue 类型
缺陷
难度
4/5
预计耗时
3-5 天
活跃度
停滞
描述清晰度
需要澄清
新手友好度
25/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。