apache / apache/doris-operator
Context deadline exceeded
- 主要语言
- Go
- 星标
- 138
- 派生
- 72
- 平均合并
- 5 天 12 小时
- 30 天内合并 PR
- 3
描述
Hi,I deployed only one node doris-operator(version 1.6.0) in k8s,and sometimes doris-operator would restart,the error as below:
E0914 01:56:25.370009 1 leaderelection.go:330] error retrieving resource lock grass-roots-wannian/e1370669.selectdb.com: Get "https://10.68.0.1:443/apis/coordination.k8s.io/v1/namespaces/grass-roots-wannian/leases/e1370669.selectdb.com": context deadline exceeded
I0914 01:56:25.370168 1 leaderelection.go:283] failed to renew lease grass-roots-wannian/e1370669.selectdb.com: timed out waiting for the condition
2024-09-14T01:56:25Z INFO Stopping and waiting for non leader election runnables
2024-09-14T01:56:25Z INFO Stopping and waiting for leader election runnables
2024-09-14T01:56:25Z INFO Stopping and waiting for caches
2024-09-14T01:56:25Z INFO Stopping and waiting for webhooks
2024-09-14T01:56:25Z INFO Wait completed, proceeding to shutdown the manager
2024-09-14T01:56:25Z INFO Shutdown signal received, waiting for all workers to finish {"controller": "doriscluster", "controllerGroup": "doris.selectdb.com", "controllerKind": "DorisCluster"}
2024-09-14T01:56:25Z INFO All workers finished {"controller": "doriscluster", "controllerGroup": "doris.selectdb.com", "controllerKind": "DorisCluster"}
2024-09-14T01:56:25Z DEBUG events doris-operator-5bfbffc6fd-jkv87_80c6fd10-a3a6-460b-86c6-79a92d37009b stopped leading {"type": "Normal", "object": {"kind":"Lease","namespace":"grass-roots-wannian","name":"e1370669.selectdb.com","uid":"9370b444-e38a-44ff-8c77-6420d2e72243","apiVersion":"coordination.k8s.io/v1","resourceVersion":"12311346"}, "reason": "LeaderElection"}
2024-09-14T01:56:25Z ERROR setup problem running manager {"error": "leader election lost"}
main.main
/workspace/cmd/operator/main.go:155
runtime.main
/usr/local/go/src/runtime/proc.go:250
Would you please help me to check it,I have no idea,thanks!
贡献指南
这个仓库没有索引到贡献指南
调研方向
从 cmd/operator/main.go:155 开始,检查丢失 leader election 后显示的 shutdown 路径。重现或调查报告的 context deadline exceeded,并确定 single operator 重启的原因;完成的标准是记录原因,并提供经过验证的修复方案或明确的后续步骤。
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- go, kubernetes
- 领域
- devops, infrastructure
- Issue 类型
- 缺陷
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 活跃度
- 停滞
- 描述清晰度
- 需要澄清
- 新手友好度
- 25/100