grpc / grpc/psm-interop

Cleanup retry leads to server/client log link message printed multiple times

Open
#44 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
9
Forks
35
Avg merge
2d 16h
Merged PRs (30d)
3

Description

Every retry adds one more link.
Example:

```
I0223 03:05:24.502794 140704337074112 k8s_base_runner.py:724] Deleting deployment psm-grpc-server
I0223 03:05:24.502925 140704337074112 k8s_port_forwarder.py:126] Shutting down PortForwarder(pid='97944', namespace='sergiitk-server-dev', destination='pod/psm-grpc-server-776f4c6fc8-lr5qd', '127.0.0.1:49197 -> 8080')
I0223 03:10:25.993897 140704337074112 retryers.py:206] Retrying framework.xds_k8s_testcase.IsolatedXdsKubernetesTestCase.cleanup in 10.0 seconds as it raised RetryError: Retry error calling framework.infrastructure.k8s.KubernetesNamespace.get_deployment: timeout 0:05:00 (h:mm:ss) exceeded. Check result callback returned False..
I0223 03:10:35.994243 140704337074112 k8s_base_runner.py:724] Deleting deployment psm-grpc-server
I0223 03:10:46.122605 140704337074112 k8s_base_runner.py:739] Deployment psm-grpc-server deleted
I0223 03:10:46.122936 140704337074112 xds_k8s_testcase.py:730] ----- Test client/server logs -----
I0223 03:10:46.123039 140704337074112 k8s_base_runner.py:919] No completed deployments of psm-grpc-client
I0223 03:10:46.123332 140704337074112 k8s_base_runner.py:976] GCP Logs Explorer link to psm-grpc-server-vqxrufda:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22sergiitk-grpc-gke%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22sergiitk-server-dev%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-vqxrufda%22;timeRange=2024-02-23T11:05:12.142681Z%2F2024-02-23T11:10:25.993601Z;cursorTimestamp=2024-02-23T11:05:20.354273Z?project=sergiitk-grpc-gke
I0223 03:10:46.123543 140704337074112 k8s_base_runner.py:976] GCP Logs Explorer link to psm-grpc-server-vqxrufda:
https://console.cloud.google.com/logs/query;query=resource.type%3D%22k8s_container%22%0Aresource.labels.project_id%3D%22sergiitk-grpc-gke%22%0Aresource.labels.container_name%3D%22psm-grpc-server%22%0Aresource.labels.namespace_name%3D%22sergiitk-server-dev%22%0Alabels.%22k8s-pod%2Fdeployment_id%22%3D%22psm-grpc-server-vqxrufda%22;timeRange=2024-02-23T11:05:12.142681Z%2F2024-02-23T11:10:46.122861Z;cursorTimestamp=2024-02-23T11:05:20.354273Z?project=sergiitk-grpc-gke
[ OK ] AffinitySessionDrainTest.test_session_drain
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.