Hooks in DAG cannot refer to output of earlier tasks in some cases

### Pre-requisites

- [X] I have double-checked my configuration
- [X] I have tested with the `:latest` image tag (i.e. `quay.io/argoproj/workflow-controller:latest`) and can confirm the issue still exists on `:latest`. If not, I have explained why, **in detail**, in my description below.
- [X] I have searched existing issues and could not find a match for this bug
- [ ] I'd like to contribute the fix myself (see [contributing guide](https://github.com/argoproj/argo-workflows/blob/main/docs/CONTRIBUTING.md))

### What happened? What did you expect to happen?

When a hook (for the `Running` state) uses the result from an earlier `task`, the variable does not get resolved. This happens only in the case of a DAG template. When I use a `steps` template, it works.

It works for `Succeeded` and for an `exit` hook. I added a `sleep 5` to the template script in order to make sure the `Running` state is triggered.

I tried using the expression syntax to refer to the output variable as well (`{{= ...}`) but without success.

As mentioned, when I use a `exit` hook, the variable gets resolved properly as can be seen in the example below.

Please note: I have only tested this on version 3.5.8 because this is the version we run and from the CHANGELOG I don't see any resolved issues that correspond to this issue.

__UPDATE__: Every now and then, it _does_ work. See below for two transcripts of the same manifest.

### Version(s)

v3.5.8

### Reproducible example

```YAML
apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
generateName: hooks-test-
spec:
serviceAccountName: argo-workflow
entrypoint: main-tasks
templates:
- name: main-tasks
dag:
tasks:
- name: task-a
template: echo
arguments:
parameters:
- name: message
value: "A message from task A"

- name: task-b
dependencies: [task-a]
template: echo
arguments:
parameters:
- name: message
value: "A message from task B"
hooks:
running:
expression: tasks["task-b"].status == "Running"
template: echo
arguments:
parameters:
- name: message
value: "A hook in a DAG task can't point to output of A: {{tasks.task-a.outputs.parameters.result}}"
succeeded:
expression: tasks["task-b"].status == "Succeeded"
template: echo
arguments:
parameters:
- name: message
value: "It works for state Succeeded: {{tasks.task-a.outputs.parameters.result}}"
exit:
template: echo
arguments:
parameters:
- name: message
value: "An exit event handler can point to output of A: {{tasks.task-a.outputs.parameters.result}}"

- name: echo
inputs:
parameters:
- name: message
outputs:
parameters:
- name: result
valueFrom:
path: /tmp/value

script:
image: bash
command: [bash]
source: |
echo "{{inputs.parameters.message}}"
echo "Some output" > /tmp/value
sleep 5
```

### Run without issues

#### Logs from the workflow controller

```text
time="2024-09-18T15:25:49.484Z" level=info msg="Processing workflow" Phase= ResourceVersion=137891013 namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.490Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=0 workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.490Z" level=info msg="Updated phase -> Running" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.490Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.490Z" level=info msg="was unable to obtain node for , letting display name to be nodeName" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.490Z" level=info msg="DAG node hooks-test-xfrrq initialized Running" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.490Z" level=warning msg="was unable to obtain the node for hooks-test-xfrrq-1007093614, taskName task-b"
time="2024-09-18T15:25:49.490Z" level=warning msg="was unable to obtain the node for hooks-test-xfrrq-990315995, taskName task-a"
time="2024-09-18T15:25:49.490Z" level=warning msg="was unable to obtain the node for hooks-test-xfrrq-990315995, taskName task-a"
time="2024-09-18T15:25:49.490Z" level=info msg="All of node hooks-test-xfrrq.task-a dependencies [] completed" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.490Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.490Z" level=info msg="Pod node hooks-test-xfrrq-990315995 initialized Pending" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.522Z" level=info msg="Created pod: hooks-test-xfrrq.task-a (hooks-test-xfrrq-echo-990315995)" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.522Z" level=warning msg="was unable to obtain the node for hooks-test-xfrrq-1007093614, taskName task-b"
time="2024-09-18T15:25:49.522Z" level=warning msg="was unable to obtain the node for hooks-test-xfrrq-1007093614, taskName task-b"
time="2024-09-18T15:25:49.522Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.522Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:49.536Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Running resourceVersion=137891016 workflow=hooks-test-xfrrq
time="2024-09-18T15:25:59.522Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=137891016 namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:59.522Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=1 workflow=hooks-test-xfrrq
time="2024-09-18T15:25:59.522Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-xfrrq-990315995 workflow=hooks-test-xfrrq
time="2024-09-18T15:25:59.522Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Running new.progress=0/1 nodeID=hooks-test-xfrrq-990315995 old.message= old.phase=Pending old.progress=0/1 workflow=hooks-test-xfrrq
time="2024-09-18T15:25:59.523Z" level=warning msg="was unable to obtain the node for hooks-test-xfrrq-1007093614, taskName task-b"
time="2024-09-18T15:25:59.523Z" level=warning msg="was unable to obtain the node for hooks-test-xfrrq-1007093614, taskName task-b"
time="2024-09-18T15:25:59.523Z" level=warning msg="was unable to obtain the node for hooks-test-xfrrq-1007093614, taskName task-b"
time="2024-09-18T15:25:59.523Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:59.523Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:25:59.534Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Running resourceVersion=137891145 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.535Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=137891145 namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.535Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=1 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.535Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-xfrrq-990315995 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.535Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Succeeded new.progress=0/1 nodeID=hooks-test-xfrrq-990315995 old.message= old.phase=Running old.progress=0/1 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.536Z" level=warning msg="was unable to obtain the node for hooks-test-xfrrq-1007093614, taskName task-b"
time="2024-09-18T15:26:09.536Z" level=warning msg="was unable to obtain the node for hooks-test-xfrrq-1007093614, taskName task-b"
time="2024-09-18T15:26:09.536Z" level=warning msg="was unable to obtain the node for hooks-test-xfrrq-1007093614, taskName task-b"
time="2024-09-18T15:26:09.536Z" level=info msg="All of node hooks-test-xfrrq.task-b dependencies [task-a] completed" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.536Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.536Z" level=info msg="Pod node hooks-test-xfrrq-1007093614 initialized Pending" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.556Z" level=info msg="Created pod: hooks-test-xfrrq.task-b (hooks-test-xfrrq-echo-1007093614)" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.557Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.557Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.570Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Running resourceVersion=137891273 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:09.576Z" level=info msg="cleaning up pod" action=labelPodCompleted key=argo-workflows/hooks-test-xfrrq-echo-990315995/labelPodCompleted
time="2024-09-18T15:26:19.557Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=137891273 namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.557Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=2 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.557Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-xfrrq-1007093614 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.557Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-xfrrq-990315995 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.557Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Running new.progress=0/1 nodeID=hooks-test-xfrrq-1007093614 old.message= old.phase=Pending old.progress=0/1 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.557Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-xfrrq.task-b.hooks.running workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.557Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.558Z" level=info msg="Pod node hooks-test-xfrrq-580714045 initialized Pending" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.562Z" level=info msg="cleaning up pod" action=terminateContainers key=argo-workflows/hooks-test-xfrrq-echo-1007093614/terminateContainers
time="2024-09-18T15:26:19.562Z" level=info msg="https://10.52.0.1:443/api/v1/namespaces/argo-workflows/pods/hooks-test-xfrrq-echo-1007093614/exec?command=%2Fvar%2Frun%2Fargo%2Fargoexec&command=kill&command=15&command=1&container=wait&stderr=true&stdout=true&tty=false"
time="2024-09-18T15:26:19.585Z" level=info msg="signaled container" container=wait error="unable to upgrade connection: container not found (\"wait\")" namespace=argo-workflows pod=hooks-test-xfrrq-echo-1007093614 stderr="" stdout=""
time="2024-09-18T15:26:19.586Z" level=info msg="Created pod: hooks-test-xfrrq.task-b.hooks.running (hooks-test-xfrrq-echo-580714045)" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.586Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-xfrrq.task-b.hooks.running workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.587Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.587Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:19.599Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Running resourceVersion=137891408 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.587Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=137891408 namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.587Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=3 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.587Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-xfrrq-990315995 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.587Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-xfrrq-1007093614 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.587Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-xfrrq-580714045 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.587Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Succeeded new.progress=0/1 nodeID=hooks-test-xfrrq-1007093614 old.message= old.phase=Running old.progress=0/1 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.587Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Running new.progress=0/1 nodeID=hooks-test-xfrrq-580714045 old.message= old.phase=Pending old.progress=0/1 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.588Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-xfrrq.task-b.hooks.running workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.588Z" level=info msg="Running hooks" hookName=succeeded lifeCycleHook=succeeded namespace=argo-workflows node=hooks-test-xfrrq.task-b.hooks.succeeded workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.588Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.588Z" level=info msg="Pod node hooks-test-xfrrq-909241011 initialized Pending" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.608Z" level=info msg="Created pod: hooks-test-xfrrq.task-b.hooks.succeeded (hooks-test-xfrrq-echo-909241011)" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.608Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-xfrrq.task-b.hooks.running workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.609Z" level=info msg="Running hooks" hookName=succeeded lifeCycleHook=succeeded namespace=argo-workflows node=hooks-test-xfrrq.task-b.hooks.succeeded workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.609Z" level=info msg="Running OnExit handler" lifeCycleHook="&LifecycleHook{Template:echo,Arguments:Arguments{Parameters:[]Parameter{Parameter{Name:message,Default:nil,Value:*An exit event handler can point to output of A: {{tasks.task-a.outputs.parameters.result}},ValueFrom:nil,GlobalName:,Enum:[],Description:nil,},},Artifacts:[]Artifact{},},TemplateRef:nil,Expression:,}" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.609Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.609Z" level=info msg="Pod node hooks-test-xfrrq-4130207657 initialized Pending" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.629Z" level=info msg="Created pod: hooks-test-xfrrq.task-b.onExit (hooks-test-xfrrq-echo-4130207657)" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.629Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.629Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.643Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Running resourceVersion=137891547 workflow=hooks-test-xfrrq
time="2024-09-18T15:26:29.649Z" level=info msg="cleaning up pod" action=labelPodCompleted key=argo-workflows/hooks-test-xfrrq-echo-1007093614/labelPodCompleted
```

#### Logs from in your workflow's wait container

```text
time="2024-09-18T15:26:18.999Z" level=info msg="Saving output parameters"
time="2024-09-18T15:26:18.999Z" level=info msg="Saving path output parameter: result"
time="2024-09-18T15:26:18.999Z" level=info msg="Copying /tmp/value from base image layer"
time="2024-09-18T15:26:18.999Z" level=info msg="Successfully saved output parameter: result"
time="2024-09-18T15:26:18.999Z" level=info msg="No output artifacts"
time="2024-09-18T15:26:19.000Z" level=info msg="GCS Save path: /tmp/argo/outputs/logs/main.log, key: argo-workflows/hooks-test-xfrrq/hooks-test-xfrrq-echo-1007093614/main.log"
time="2024-09-18T15:26:19.336Z" level=info msg="Save artifact" artifactName=main-logs duration=336.403755ms error="" key=argo-workflows/hooks-test-xfrrq/hooks-test-xfrrq-echo-1007093614/main.log
time="2024-09-18T15:26:19.336Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/logs/main.log
time="2024-09-18T15:26:19.336Z" level=info msg="Successfully saved file: /tmp/argo/outputs/logs/main.log"
time="2024-09-18T15:26:19.357Z" level=info msg="Alloc=26560 TotalAlloc=33074 Sys=40293 NumGC=4 Goroutines=11"
time="2024-09-18T15:26:39.453Z" level=info msg="Saving output parameters"
time="2024-09-18T15:26:39.453Z" level=info msg="Saving path output parameter: result"
time="2024-09-18T15:26:39.453Z" level=info msg="Copying /tmp/value from base image layer"
time="2024-09-18T15:26:39.453Z" level=info msg="Successfully saved output parameter: result"
time="2024-09-18T15:26:39.453Z" level=info msg="No output artifacts"
time="2024-09-18T15:26:39.454Z" level=info msg="GCS Save path: /tmp/argo/outputs/logs/main.log, key: argo-workflows/hooks-test-xfrrq/hooks-test-xfrrq-echo-4130207657/main.log"
time="2024-09-18T15:26:39.811Z" level=info msg="Save artifact" artifactName=main-logs duration=357.370907ms error="" key=argo-workflows/hooks-test-xfrrq/hooks-test-xfrrq-echo-4130207657/main.log
time="2024-09-18T15:26:39.811Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/logs/main.log
time="2024-09-18T15:26:39.811Z" level=info msg="Successfully saved file: /tmp/argo/outputs/logs/main.log"
time="2024-09-18T15:26:39.846Z" level=info msg="Alloc=26503 TotalAlloc=33067 Sys=40037 NumGC=5 Goroutines=11"
time="2024-09-18T15:26:30.103Z" level=info msg="Saving output parameters"
time="2024-09-18T15:26:30.103Z" level=info msg="Saving path output parameter: result"
time="2024-09-18T15:26:30.103Z" level=info msg="Copying /tmp/value from base image layer"
time="2024-09-18T15:26:30.103Z" level=info msg="Successfully saved output parameter: result"
time="2024-09-18T15:26:30.103Z" level=info msg="No output artifacts"
time="2024-09-18T15:26:30.103Z" level=info msg="GCS Save path: /tmp/argo/outputs/logs/main.log, key: argo-workflows/hooks-test-xfrrq/hooks-test-xfrrq-echo-580714045/main.log"
time="2024-09-18T15:26:30.378Z" level=info msg="Save artifact" artifactName=main-logs duration=274.5822ms error="" key=argo-workflows/hooks-test-xfrrq/hooks-test-xfrrq-echo-580714045/main.log
time="2024-09-18T15:26:30.378Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/logs/main.log
time="2024-09-18T15:26:30.378Z" level=info msg="Successfully saved file: /tmp/argo/outputs/logs/main.log"
time="2024-09-18T15:26:30.393Z" level=info msg="Alloc=26522 TotalAlloc=33086 Sys=40037 NumGC=5 Goroutines=11"
time="2024-09-18T15:26:40.111Z" level=info msg="Saving output parameters"
time="2024-09-18T15:26:40.111Z" level=info msg="Saving path output parameter: result"
time="2024-09-18T15:26:40.111Z" level=info msg="Copying /tmp/value from base image layer"
time="2024-09-18T15:26:40.111Z" level=info msg="Successfully saved output parameter: result"
time="2024-09-18T15:26:40.111Z" level=info msg="No output artifacts"
time="2024-09-18T15:26:40.112Z" level=info msg="GCS Save path: /tmp/argo/outputs/logs/main.log, key: argo-workflows/hooks-test-xfrrq/hooks-test-xfrrq-echo-909241011/main.log"
time="2024-09-18T15:26:40.351Z" level=info msg="Save artifact" artifactName=main-logs duration=239.139726ms error="" key=argo-workflows/hooks-test-xfrrq/hooks-test-xfrrq-echo-909241011/main.log
time="2024-09-18T15:26:40.351Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/logs/main.log
time="2024-09-18T15:26:40.351Z" level=info msg="Successfully saved file: /tmp/argo/outputs/logs/main.log"
time="2024-09-18T15:26:40.373Z" level=info msg="Alloc=26585 TotalAlloc=33112 Sys=40037 NumGC=5 Goroutines=11"
time="2024-09-18T15:25:59.811Z" level=info msg="Saving output parameters"
time="2024-09-18T15:25:59.811Z" level=info msg="Saving path output parameter: result"
time="2024-09-18T15:25:59.812Z" level=info msg="Copying /tmp/value from base image layer"
time="2024-09-18T15:25:59.812Z" level=info msg="Successfully saved output parameter: result"
time="2024-09-18T15:25:59.812Z" level=info msg="No output artifacts"
time="2024-09-18T15:25:59.812Z" level=info msg="GCS Save path: /tmp/argo/outputs/logs/main.log, key: argo-workflows/hooks-test-xfrrq/hooks-test-xfrrq-echo-990315995/main.log"
time="2024-09-18T15:26:00.165Z" level=info msg="Save artifact" artifactName=main-logs duration=353.015361ms error="" key=argo-workflows/hooks-test-xfrrq/hooks-test-xfrrq-echo-990315995/main.log
time="2024-09-18T15:26:00.165Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/logs/main.log
time="2024-09-18T15:26:00.165Z" level=info msg="Successfully saved file: /tmp/argo/outputs/logs/main.log"
time="2024-09-18T15:26:00.186Z" level=info msg="Alloc=26494 TotalAlloc=33062 Sys=40037 NumGC=5 Goroutines=11"
```

### Run with issues

#### Logs from the workflow controller

```text
time="2024-09-18T15:27:36.206Z" level=info msg="Processing workflow" Phase= ResourceVersion=137892414 namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.213Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=0 workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.213Z" level=info msg="Updated phase -> Running" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.214Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.214Z" level=info msg="was unable to obtain node for , letting display name to be nodeName" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.214Z" level=info msg="DAG node hooks-test-nw4lb initialized Running" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.214Z" level=warning msg="was unable to obtain the node for hooks-test-nw4lb-1806672228, taskName task-b"
time="2024-09-18T15:27:36.214Z" level=warning msg="was unable to obtain the node for hooks-test-nw4lb-1857005085, taskName task-a"
time="2024-09-18T15:27:36.214Z" level=warning msg="was unable to obtain the node for hooks-test-nw4lb-1857005085, taskName task-a"
time="2024-09-18T15:27:36.214Z" level=info msg="All of node hooks-test-nw4lb.task-a dependencies [] completed" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.214Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.214Z" level=info msg="Pod node hooks-test-nw4lb-1857005085 initialized Pending" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.243Z" level=info msg="Created pod: hooks-test-nw4lb.task-a (hooks-test-nw4lb-echo-1857005085)" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.243Z" level=warning msg="was unable to obtain the node for hooks-test-nw4lb-1806672228, taskName task-b"
time="2024-09-18T15:27:36.243Z" level=warning msg="was unable to obtain the node for hooks-test-nw4lb-1806672228, taskName task-b"
time="2024-09-18T15:27:36.243Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.243Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:36.254Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Running resourceVersion=137892418 workflow=hooks-test-nw4lb
time="2024-09-18T15:27:46.244Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=137892418 namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:46.244Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=1 workflow=hooks-test-nw4lb
time="2024-09-18T15:27:46.244Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-1857005085 workflow=hooks-test-nw4lb
time="2024-09-18T15:27:46.244Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Running new.progress=0/1 nodeID=hooks-test-nw4lb-1857005085 old.message= old.phase=Pending old.progress=0/1 workflow=hooks-test-nw4lb
time="2024-09-18T15:27:46.244Z" level=warning msg="was unable to obtain the node for hooks-test-nw4lb-1806672228, taskName task-b"
time="2024-09-18T15:27:46.244Z" level=warning msg="was unable to obtain the node for hooks-test-nw4lb-1806672228, taskName task-b"
time="2024-09-18T15:27:46.244Z" level=warning msg="was unable to obtain the node for hooks-test-nw4lb-1806672228, taskName task-b"
time="2024-09-18T15:27:46.244Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:46.244Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:46.255Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Running resourceVersion=137892538 workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.257Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=137892538 namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.257Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=1 workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.257Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-1857005085 workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.257Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Succeeded new.progress=0/1 nodeID=hooks-test-nw4lb-1857005085 old.message= old.phase=Running old.progress=0/1 workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.257Z" level=warning msg="was unable to obtain the node for hooks-test-nw4lb-1806672228, taskName task-b"
time="2024-09-18T15:27:56.257Z" level=warning msg="was unable to obtain the node for hooks-test-nw4lb-1806672228, taskName task-b"
time="2024-09-18T15:27:56.257Z" level=warning msg="was unable to obtain the node for hooks-test-nw4lb-1806672228, taskName task-b"
time="2024-09-18T15:27:56.257Z" level=info msg="All of node hooks-test-nw4lb.task-b dependencies [task-a] completed" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.257Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.257Z" level=info msg="Pod node hooks-test-nw4lb-1806672228 initialized Pending" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.278Z" level=info msg="Created pod: hooks-test-nw4lb.task-b (hooks-test-nw4lb-echo-1806672228)" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.278Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.278Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.292Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Running resourceVersion=137892665 workflow=hooks-test-nw4lb
time="2024-09-18T15:27:56.299Z" level=info msg="cleaning up pod" action=labelPodCompleted key=argo-workflows/hooks-test-nw4lb-echo-1857005085/labelPodCompleted
time="2024-09-18T15:28:06.278Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=137892665 namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.278Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=2 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.278Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-1806672228 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.278Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-1857005085 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.278Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Running new.progress=0/1 nodeID=hooks-test-nw4lb-1806672228 old.message= old.phase=Pending old.progress=0/1 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.279Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.running workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.279Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.279Z" level=info msg="Pod node hooks-test-nw4lb-2706755023 initialized Pending" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.307Z" level=info msg="Created pod: hooks-test-nw4lb.task-b.hooks.running (hooks-test-nw4lb-echo-2706755023)" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.307Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.running workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.307Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.307Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:06.320Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Running resourceVersion=137892795 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.308Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=137892795 namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.308Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=3 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.308Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-2706755023 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.308Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-1857005085 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.308Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-1806672228 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.308Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Succeeded new.progress=0/1 nodeID=hooks-test-nw4lb-1806672228 old.message= old.phase=Running old.progress=0/1 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.308Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Running new.progress=0/1 nodeID=hooks-test-nw4lb-2706755023 old.message= old.phase=Pending old.progress=0/1 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.309Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.running workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.309Z" level=info msg="Running hooks" hookName=succeeded lifeCycleHook=succeeded namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.succeeded workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.309Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.309Z" level=info msg="Pod node hooks-test-nw4lb-4164447789 initialized Pending" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.332Z" level=info msg="Created pod: hooks-test-nw4lb.task-b.hooks.succeeded (hooks-test-nw4lb-echo-4164447789)" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.332Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.running workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.332Z" level=info msg="Running hooks" hookName=succeeded lifeCycleHook=succeeded namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.succeeded workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.332Z" level=info msg="Running OnExit handler" lifeCycleHook="&LifecycleHook{Template:echo,Arguments:Arguments{Parameters:[]Parameter{Parameter{Name:message,Default:nil,Value:*An exit event handler can point to output of A: {{tasks.task-a.outputs.parameters.result}},ValueFrom:nil,GlobalName:,Enum:[],Description:nil,},},Artifacts:[]Artifact{},},TemplateRef:nil,Expression:,}" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.332Z" level=warning msg="Node was nil, will be initialized as type Skipped" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.333Z" level=info msg="Pod node hooks-test-nw4lb-516478903 initialized Pending" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.352Z" level=info msg="Created pod: hooks-test-nw4lb.task-b.onExit (hooks-test-nw4lb-echo-516478903)" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.352Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.352Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.366Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Running resourceVersion=137892928 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:16.372Z" level=info msg="cleaning up pod" action=labelPodCompleted key=argo-workflows/hooks-test-nw4lb-echo-1806672228/labelPodCompleted
time="2024-09-18T15:28:26.332Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=137892928 namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.332Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=5 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.332Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-1857005085 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.332Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-1806672228 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.332Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-2706755023 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.332Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-516478903 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.332Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-4164447789 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.333Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Running new.progress=0/1 nodeID=hooks-test-nw4lb-516478903 old.message= old.phase=Pending old.progress=0/1 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.333Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Succeeded new.progress=0/1 nodeID=hooks-test-nw4lb-2706755023 old.message= old.phase=Running old.progress=0/1 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.333Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Running new.progress=0/1 nodeID=hooks-test-nw4lb-4164447789 old.message= old.phase=Pending old.progress=0/1 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.333Z" level=info msg="Running hooks" hookName=succeeded lifeCycleHook=succeeded namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.succeeded workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.333Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.running workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.334Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.running workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.334Z" level=info msg="Running hooks" hookName=succeeded lifeCycleHook=succeeded namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.succeeded workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.334Z" level=info msg="Running OnExit handler" lifeCycleHook="&LifecycleHook{Template:echo,Arguments:Arguments{Parameters:[]Parameter{Parameter{Name:message,Default:nil,Value:*An exit event handler can point to output of A: {{tasks.task-a.outputs.parameters.result}},ValueFrom:nil,GlobalName:,Enum:[],Description:nil,},},Artifacts:[]Artifact{},},TemplateRef:nil,Expression:,}" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.334Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.334Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.345Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Running resourceVersion=137893065 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:26.352Z" level=info msg="cleaning up pod" action=labelPodCompleted key=argo-workflows/hooks-test-nw4lb-echo-2706755023/labelPodCompleted
time="2024-09-18T15:28:36.346Z" level=info msg="Processing workflow" Phase=Running ResourceVersion=137893065 namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.346Z" level=info msg="Task-result reconciliation" namespace=argo-workflows numObjs=5 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.347Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-1857005085 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.347Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-1806672228 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.347Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-2706755023 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.347Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-516478903 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.347Z" level=info msg="task-result changed" namespace=argo-workflows nodeID=hooks-test-nw4lb-4164447789 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.347Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Succeeded new.progress=0/1 nodeID=hooks-test-nw4lb-4164447789 old.message= old.phase=Running old.progress=0/1 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.347Z" level=info msg="node changed" namespace=argo-workflows new.message= new.phase=Succeeded new.progress=0/1 nodeID=hooks-test-nw4lb-516478903 old.message= old.phase=Running old.progress=0/1 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.347Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.running workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.347Z" level=info msg="Running hooks" hookName=succeeded lifeCycleHook=succeeded namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.succeeded workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg="Running OnExit handler" lifeCycleHook="&LifecycleHook{Template:echo,Arguments:Arguments{Parameters:[]Parameter{Parameter{Name:message,Default:nil,Value:*An exit event handler can point to output of A: {{tasks.task-a.outputs.parameters.result}},ValueFrom:nil,GlobalName:,Enum:[],Description:nil,},},Artifacts:[]Artifact{},},TemplateRef:nil,Expression:,}" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg="Running hooks" hookName=succeeded lifeCycleHook=succeeded namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.succeeded workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg="Running hooks" hookName=running lifeCycleHook=running namespace=argo-workflows node=hooks-test-nw4lb.task-b.hooks.running workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg="Running OnExit handler" lifeCycleHook="&LifecycleHook{Template:echo,Arguments:Arguments{Parameters:[]Parameter{Parameter{Name:message,Default:nil,Value:*An exit event handler can point to output of A: {{tasks.task-a.outputs.parameters.result}},ValueFrom:nil,GlobalName:,Enum:[],Description:nil,},},Artifacts:[]Artifact{},},TemplateRef:nil,Expression:,}" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg="Outbound nodes of hooks-test-nw4lb set to [hooks-test-nw4lb-1806672228]" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg="node hooks-test-nw4lb phase Running -> Succeeded" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg="node hooks-test-nw4lb finished: 2024-09-18 15:28:36.348728387 +0000 UTC" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg="TaskSet Reconciliation" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg=reconcileAgentPod namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg="Updated phase Running -> Succeeded" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg="Marking workflow completed" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.348Z" level=info msg="Marking workflow as pending archiving" namespace=argo-workflows workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.354Z" level=info msg="cleaning up pod" action=deletePod key=argo-workflows/hooks-test-nw4lb-1340600742-agent/deletePod
time="2024-09-18T15:28:36.360Z" level=info msg="Workflow update successful" namespace=argo-workflows phase=Succeeded resourceVersion=137893200 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.382Z" level=info msg="archiving workflow" namespace=argo-workflows uid=32b4d529-9c5e-4468-9923-882481292cd6 workflow=hooks-test-nw4lb
time="2024-09-18T15:28:36.387Z" level=info msg="cleaning up pod" action=labelPodCompleted key=argo-workflows/hooks-test-nw4lb-echo-4164447789/labelPodCompleted
time="2024-09-18T15:28:36.387Z" level=info msg="cleaning up pod" action=labelPodCompleted key=argo-workflows/hooks-test-nw4lb-echo-516478903/labelPodCompleted
```

#### Logs from in your workflow's wait container

```text
time="2024-09-18T15:28:16.804Z" level=info msg="Saving output parameters"
time="2024-09-18T15:28:16.804Z" level=info msg="Saving path output parameter: result"
time="2024-09-18T15:28:16.804Z" level=info msg="Copying /tmp/value from base image layer"
time="2024-09-18T15:28:16.804Z" level=info msg="Successfully saved output parameter: result"
time="2024-09-18T15:28:16.804Z" level=info msg="No output artifacts"
time="2024-09-18T15:28:16.805Z" level=info msg="GCS Save path: /tmp/argo/outputs/logs/main.log, key: argo-workflows/hooks-test-nw4lb/hooks-test-nw4lb-echo-2706755023/main.log"
time="2024-09-18T15:28:17.163Z" level=info msg="Save artifact" artifactName=main-logs duration=358.150592ms error="" key=argo-workflows/hooks-test-nw4lb/hooks-test-nw4lb-echo-2706755023/main.log
time="2024-09-18T15:28:17.163Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/logs/main.log
time="2024-09-18T15:28:17.163Z" level=info msg="Successfully saved file: /tmp/argo/outputs/logs/main.log"
time="2024-09-18T15:28:17.182Z" level=info msg="Alloc=26679 TotalAlloc=33061 Sys=40037 NumGC=4 Goroutines=11"
time="2024-09-18T15:28:26.906Z" level=info msg="Saving output parameters"
time="2024-09-18T15:28:26.906Z" level=info msg="Saving path output parameter: result"
time="2024-09-18T15:28:26.906Z" level=info msg="Copying /tmp/value from base image layer"
time="2024-09-18T15:28:26.906Z" level=info msg="Successfully saved output parameter: result"
time="2024-09-18T15:28:26.906Z" level=info msg="No output artifacts"
time="2024-09-18T15:28:26.906Z" level=info msg="GCS Save path: /tmp/argo/outputs/logs/main.log, key: argo-workflows/hooks-test-nw4lb/hooks-test-nw4lb-echo-4164447789/main.log"
time="2024-09-18T15:28:27.156Z" level=info msg="Save artifact" artifactName=main-logs duration=250.278259ms error="" key=argo-workflows/hooks-test-nw4lb/hooks-test-nw4lb-echo-4164447789/main.log
time="2024-09-18T15:28:27.156Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/logs/main.log
time="2024-09-18T15:28:27.156Z" level=info msg="Successfully saved file: /tmp/argo/outputs/logs/main.log"
time="2024-09-18T15:28:27.186Z" level=info msg="Alloc=26576 TotalAlloc=33074 Sys=40037 NumGC=4 Goroutines=11"
time="2024-09-18T15:28:26.649Z" level=info msg="Saving path output parameter: result"
time="2024-09-18T15:28:26.649Z" level=info msg="Copying /tmp/value from base image layer"
time="2024-09-18T15:28:26.649Z" level=info msg="Successfully saved output parameter: result"
time="2024-09-18T15:28:26.649Z" level=info msg="No output artifacts"
time="2024-09-18T15:28:26.650Z" level=info msg="GCS Save path: /tmp/argo/outputs/logs/main.log, key: argo-workflows/hooks-test-nw4lb/hooks-test-nw4lb-echo-516478903/main.log"
time="2024-09-18T15:28:26.904Z" level=info msg="Save artifact" artifactName=main-logs duration=253.917636ms error="" key=argo-workflows/hooks-test-nw4lb/hooks-test-nw4lb-echo-516478903/main.log
time="2024-09-18T15:28:26.904Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/logs/main.log
time="2024-09-18T15:28:26.904Z" level=info msg="Successfully saved file: /tmp/argo/outputs/logs/main.log"
time="2024-09-18T15:28:26.922Z" level=info msg="Alloc=26559 TotalAlloc=33079 Sys=40293 NumGC=4 Goroutines=11"
time="2024-09-18T15:28:26.931Z" level=info msg="Deadline monitor stopped"
time="2024-09-18T15:28:07.802Z" level=info msg="Saving output parameters"
time="2024-09-18T15:28:07.802Z" level=info msg="Saving path output parameter: result"
time="2024-09-18T15:28:07.802Z" level=info msg="Copying /tmp/value from base image layer"
time="2024-09-18T15:28:07.802Z" level=info msg="Successfully saved output parameter: result"
time="2024-09-18T15:28:07.802Z" level=info msg="No output artifacts"
time="2024-09-18T15:28:07.802Z" level=info msg="GCS Save path: /tmp/argo/outputs/logs/main.log, key: argo-workflows/hooks-test-nw4lb/hooks-test-nw4lb-echo-1806672228/main.log"
time="2024-09-18T15:28:08.070Z" level=info msg="Save artifact" artifactName=main-logs duration=267.048954ms error="" key=argo-workflows/hooks-test-nw4lb/hooks-test-nw4lb-echo-1806672228/main.log
time="2024-09-18T15:28:08.070Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/logs/main.log
time="2024-09-18T15:28:08.070Z" level=info msg="Successfully saved file: /tmp/argo/outputs/logs/main.log"
time="2024-09-18T15:28:08.093Z" level=info msg="Alloc=26511 TotalAlloc=33062 Sys=40037 NumGC=5 Goroutines=11"
time="2024-09-18T15:27:46.602Z" level=info msg="Saving output parameters"
time="2024-09-18T15:27:46.602Z" level=info msg="Saving path output parameter: result"
time="2024-09-18T15:27:46.602Z" level=info msg="Copying /tmp/value from base image layer"
time="2024-09-18T15:27:46.602Z" level=info msg="Successfully saved output parameter: result"
time="2024-09-18T15:27:46.602Z" level=info msg="No output artifacts"
time="2024-09-18T15:27:46.602Z" level=info msg="GCS Save path: /tmp/argo/outputs/logs/main.log, key: argo-workflows/hooks-test-nw4lb/hooks-test-nw4lb-echo-1857005085/main.log"
time="2024-09-18T15:27:46.869Z" level=info msg="Save artifact" artifactName=main-logs duration=266.429811ms error="" key=argo-workflows/hooks-test-nw4lb/hooks-test-nw4lb-echo-1857005085/main.log
time="2024-09-18T15:27:46.869Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/logs/main.log
time="2024-09-18T15:27:46.869Z" level=info msg="Successfully saved file: /tmp/argo/outputs/logs/main.log"
time="2024-09-18T15:27:46.887Z" level=info msg="Alloc=26562 TotalAlloc=33078 Sys=40293 NumGC=4 Goroutines=11"
```

Start with the reproducible workflow YAML and the workflow controller behavior for DAG running hooks. Compare output resolution in the running hook with the steps, succeeded, and exit-hook cases, including repeated runs because the report is intermittent. Done means the earlier task's output resolves consistently in the DAG running hook.

Written by the indexing model from the issue text.