`Error updating workflow` causes workflow to never end and ignore `activeDeadlineSeconds`

### Pre-requisites

- [x] I have double-checked my configuration
- [x] I have tested with the `:latest` image tag (i.e. `quay.io/argoproj/workflow-controller:latest`) and can confirm the issue still exists on `:latest`. If not, I have explained why, **in detail**, in my description below.
- [x] I have searched existing issues and could not find a match for this bug
- [ ] I'd like to contribute the fix myself (see [contributing guide](https://github.com/argoproj/argo-workflows/blob/main/docs/CONTRIBUTING.md))

### What happened? What did you expect to happen?

Recently, I've noticed, that 3 workflows had a problem updating their status:
```
Error updating workflow: Put \"https://10.190.9.1:443/apis/argoproj.io/v1alpha1/namespaces/resource-usage/workflows/jobs-resource-usage-calculate-requests-count-1m-1751151780\": dial tcp 10.190.9.1:443: connect: connection refused
```
All these workflows usually finish their work under 30 seconds. This situation caused workflows to continue running infinitely blocking next runs from starting (parallelism limit).

I had to manually stop workflows from UI.

All workflows had `activeDeadlineSeconds` set for 2 hours, but they was running for more then several days:

### Version(s)

v.3.5.10

### Paste a minimal workflow that reproduces the issue. We must be able to run the workflow; don't enter a workflow that uses private images.

```YAML
n/a, error doesn't depend on workflow parameters
```

### Logs from the workflow controller

```text
[
{
"insertId": "osbwj94meyrus581",
"jsonPayload": {
"Phase": "Running",
"ResourceVersion": "2113053397",
"level": "info",
"workflow": "jobs-resource-usage-calculate-requests-count-1m-1751151780",
"namespace": "resource-usage",
"msg": "Processing workflow"
},
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "mycomp",
"namespace_name": "argo-workflows",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"container_name": "controller",
"cluster_name": "mycomp-prod",
"location": "europe-west4-c"
}
},
"timestamp": "2025-06-28T23:03:25.891Z",
"severity": "INFO",
"labels": {
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"logging.gke.io/top_level_controller_type": "Deployment",
"k8s-pod/app": "workflow-controller",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller",
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:03:29.066668749Z"
},
{
"insertId": "aaur8bp2g82od354",
"jsonPayload": {
"msg": "reconcileAgentPod",
"level": "info",
"namespace": "resource-usage",
"workflow": "jobs-resource-usage-calculate-requests-count-1m-1751151780"
},
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"namespace_name": "argo-workflows",
"container_name": "controller",
"project_id": "mycomp",
"location": "europe-west4-c",
"cluster_name": "mycomp-prod"
}
},
"timestamp": "2025-06-28T23:03:25.892Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"k8s-pod/app": "workflow-controller",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"logging.gke.io/top_level_controller_type": "Deployment",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7",
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:03:29.066668749Z"
},
{
"insertId": "gl56aiw5cbh8xhbp",
"jsonPayload": {
"namespace": "resource-usage",
"workflow": "jobs-resource-usage-calculate-requests-count-1m-1751151780",
"msg": "Marking workflow as pending archiving",
"level": "info"
},
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "controller",
"cluster_name": "mycomp-prod",
"project_id": "mycomp",
"namespace_name": "argo-workflows",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"location": "europe-west4-c"
}
},
"timestamp": "2025-06-28T23:03:25.892Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "workflow-controller",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"logging.gke.io/top_level_controller_type": "Deployment",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:03:29.066668749Z"
},
{
"insertId": "lk3lj99zz360fssl",
"jsonPayload": {
"workflow": "jobs-resource-usage-calculate-requests-count-1m-1751151780",
"msg": "TaskSet Reconciliation",
"namespace": "resource-usage",
"level": "info"
},
"resource": {
"type": "k8s_container",
"labels": {
"location": "europe-west4-c",
"cluster_name": "mycomp-prod",
"project_id": "mycomp",
"container_name": "controller",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"namespace_name": "argo-workflows"
}
},
"timestamp": "2025-06-28T23:03:25.892Z",
"severity": "INFO",
"labels": {
"logging.gke.io/top_level_controller_type": "Deployment",
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7",
"k8s-pod/app": "workflow-controller",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:03:29.066668749Z"
},
{
"insertId": "ot9763haiiyhzdb3",
"jsonPayload": {
"new.message": "",
"new.phase": "Succeeded",
"old.progress": "0/1",
"new.progress": "0/1",
"level": "info",
"old.phase": "Running",
"msg": "node changed",
"namespace": "resource-usage",
"old.message": "",
"nodeID": "jobs-resource-usage-calculate-requests-count-1m-1751151780",
"workflow": "jobs-resource-usage-calculate-requests-count-1m-1751151780"
},
"resource": {
"type": "k8s_container",
"labels": {
"location": "europe-west4-c",
"project_id": "mycomp",
"namespace_name": "argo-workflows",
"cluster_name": "mycomp-prod",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"container_name": "controller"
}
},
"timestamp": "2025-06-28T23:03:25.892Z",
"severity": "INFO",
"labels": {
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"k8s-pod/app": "workflow-controller",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7",
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"logging.gke.io/top_level_controller_type": "Deployment"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:03:29.066668749Z"
},
{
"insertId": "rhymtiuenz6z8py5",
"jsonPayload": {
"workflow": "jobs-resource-usage-calculate-requests-count-1m-1751151780",
"level": "info",
"msg": "Marking workflow completed",
"namespace": "resource-usage"
},
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "argo-workflows",
"container_name": "controller",
"cluster_name": "mycomp-prod",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"location": "europe-west4-c",
"project_id": "mycomp"
}
},
"timestamp": "2025-06-28T23:03:25.892Z",
"severity": "INFO",
"labels": {
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"logging.gke.io/top_level_controller_type": "Deployment",
"k8s-pod/app": "workflow-controller",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller",
"k8s-pod/pod-template-hash": "6c5bbbfcf7"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:03:29.066668749Z"
},
{
"insertId": "trxyvw7rig1a7u0c",
"jsonPayload": {
"level": "info",
"namespace": "resource-usage",
"workflow": "jobs-resource-usage-calculate-requests-count-1m-1751151780",
"msg": "Updated phase Running -> Succeeded"
},
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "controller",
"location": "europe-west4-c",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"cluster_name": "mycomp-prod",
"project_id": "mycomp",
"namespace_name": "argo-workflows"
}
},
"timestamp": "2025-06-28T23:03:25.892Z",
"severity": "INFO",
"labels": {
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"k8s-pod/app": "workflow-controller",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7",
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller",
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"logging.gke.io/top_level_controller_type": "Deployment"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:03:29.066668749Z"
},
{
"insertId": "vs5rol15qxbtmqbs",
"jsonPayload": {
"namespace": "resource-usage",
"msg": "task-result changed",
"workflow": "jobs-resource-usage-calculate-requests-count-1m-1751151780",
"level": "info",
"nodeID": "jobs-resource-usage-calculate-requests-count-1m-1751151780"
},
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "argo-workflows",
"location": "europe-west4-c",
"project_id": "mycomp",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"cluster_name": "mycomp-prod",
"container_name": "controller"
}
},
"timestamp": "2025-06-28T23:03:25.892Z",
"severity": "INFO",
"labels": {
"logging.gke.io/top_level_controller_type": "Deployment",
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller",
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"k8s-pod/app": "workflow-controller",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:03:29.066668749Z"
},
{
"insertId": "w0qpr5td09zd75dv",
"jsonPayload": {
"namespace": "resource-usage",
"level": "info",
"workflow": "jobs-resource-usage-calculate-requests-count-1m-1751151780",
"msg": "Task-result reconciliation",
"numObjs": 1
},
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "mycomp-prod",
"location": "europe-west4-c",
"project_id": "mycomp",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"namespace_name": "argo-workflows",
"container_name": "controller"
}
},
"timestamp": "2025-06-28T23:03:25.892Z",
"severity": "INFO",
"labels": {
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"k8s-pod/app": "workflow-controller",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"logging.gke.io/top_level_controller_type": "Deployment",
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller",
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:03:29.066668749Z"
},
{
"insertId": "2wbprnxyj3v3paw0",
"jsonPayload": {
"msg": "Error updating workflow: Put \"https://10.190.9.1:443/apis/argoproj.io/v1alpha1/namespaces/resource-usage/workflows/jobs-resource-usage-calculate-requests-count-1m-1751151780\": dial tcp 10.190.9.1:443: connect: connection refused ",
"level": "warning",
"workflow": "jobs-resource-usage-calculate-requests-count-1m-1751151780",
"namespace": "resource-usage"
},
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "mycomp-prod",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"location": "europe-west4-c",
"container_name": "controller",
"namespace_name": "argo-workflows",
"project_id": "mycomp"
}
},
"timestamp": "2025-06-28T23:03:25.894Z",
"severity": "WARNING",
"labels": {
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7",
"logging.gke.io/top_level_controller_type": "Deployment",
"k8s-pod/app": "workflow-controller",
"k8s-pod/app_kubernetes_io/managed-by": "Helm"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:03:29.066668749Z"
},
{
"insertId": "7v7rqmaaz97wn75u",
"jsonPayload": {
"level": "info",
"msg": "Workflow processing has been postponed due to max parallelism limit",
"key": "resource-usage/jobs-resource-usage-calculate-requests-count-1m-1751151780"
},
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "controller",
"location": "europe-west4-c",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"cluster_name": "mycomp-prod",
"project_id": "mycomp",
"namespace_name": "argo-workflows"
}
},
"timestamp": "2025-06-28T23:11:24.909Z",
"severity": "INFO",
"labels": {
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"logging.gke.io/top_level_controller_type": "Deployment",
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller",
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"k8s-pod/app": "workflow-controller",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/app_kubernetes_io/component": "workflow-controller"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:11:29.027221114Z"
},
{
"insertId": "z62aiy0degg2tz8h",
"jsonPayload": {
"msg": "Workflow processing has been postponed due to max parallelism limit",
"key": "resource-usage/jobs-resource-usage-calculate-requests-count-1m-1751151780",
"level": "info"
},
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "controller",
"namespace_name": "argo-workflows",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"project_id": "mycomp",
"cluster_name": "mycomp-prod",
"location": "europe-west4-c"
}
},
"timestamp": "2025-06-28T23:16:36.467Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "workflow-controller",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"logging.gke.io/top_level_controller_type": "Deployment",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:16:39.026183287Z"
},
{
"insertId": "exh3jurd3vwb99tm",
"jsonPayload": {
"key": "resource-usage/jobs-resource-usage-calculate-requests-count-1m-1751151780",
"level": "info",
"msg": "Workflow processing has been postponed due to max parallelism limit"
},
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "mycomp-prod",
"pod_name": "argo-workflows-workflow-controller-6c5bbbfcf7-qh4zw",
"project_id": "mycomp",
"container_name": "controller",
"namespace_name": "argo-workflows",
"location": "europe-west4-c"
}
},
"timestamp": "2025-06-28T23:18:14.084Z",
"severity": "INFO",
"labels": {
"k8s-pod/app_kubernetes_io/part-of": "argo-workflows",
"k8s-pod/app_kubernetes_io/version": "v3.6.10",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-16-81bffa56-fzu7",
"logging.gke.io/top_level_controller_type": "Deployment",
"k8s-pod/helm_sh/chart": "argoWorkflows-0.45.19",
"k8s-pod/pod-template-hash": "6c5bbbfcf7",
"k8s-pod/app_kubernetes_io/instance": "argo-workflows",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"logging.gke.io/top_level_controller_name": "argo-workflows-workflow-controller",
"k8s-pod/app_kubernetes_io/component": "workflow-controller",
"k8s-pod/app_kubernetes_io/name": "argo-workflows-workflow-controller",
"k8s-pod/app": "workflow-controller"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:18:19.080836110Z"
}
]
```

### Logs from in your workflow's wait container

```text
{
"insertId": "yctymeuxzyni6vrm",
"jsonPayload": {
"deadline": "0001-01-01T00:00:00Z",
"namespace": "resource-usage",
"templateName": "run-job",
"level": "info",
"version": "&Version{Version:v3.6.10,BuildDate:2025-06-04T12:47:02Z,GitCommit:459c19db6e9dd86dd757c21644404cb784863fae,GitTag:v3.6.10,GitTreeState:clean,GoVersion:go1.24.3,Compiler:gc,Platform:linux/amd64,}",
"msg": "Executor initialized",
"includeScriptOutput": false,
"podName": "jobs-resource-usage-calculate-requests-count-1m-1751151780"
},
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "jobs-resource-usage-calculate-requests-count-1m-1751151780",
"location": "europe-west4-c",
"container_name": "wait",
"namespace_name": "resource-usage",
"cluster_name": "mycomp-prod",
"project_id": "mycomp"
}
},
"timestamp": "2025-06-28T23:03:04.093Z",
"severity": "INFO",
"labels": {
"k8s-pod/workflows_argoproj_io/workflow": "jobs-resource-usage-calculate-requests-count-1m-1751151780",
"k8s-pod/workflows_argoproj_io/completed": "false",
"k8s-pod/app_kubernetes_io/component": "jobs",
"compute.googleapis.com/resource_name": "gke-mycomp-prod-pool-jobs-4-11432249-dtg4",
"k8s-pod/workflows_argoproj_io/workflow-template": "jobs-resource-usage-calculate-requests-count",
"k8s-pod/app_kubernetes_io/managed-by": "Helm",
"k8s-pod/app_kubernetes_io/instance": "jobs-resource-usage",
"k8s-pod/helm_sh/chart": "jobs-0.2.92",
"k8s-pod/app_kubernetes_io/name": "jobs"
},
"logName": "projects/mycomp/logs/stderr",
"receiveTimestamp": "2025-06-28T23:03:06.564541225Z"
}
```

No source file, test, or reproducible workflow is named. Start with the workflow-controller logs around “Error updating workflow” and activeDeadlineSeconds, then verify done by confirming an update failure cannot leave a workflow running past its deadline.

Written by the indexing model from the issue text.