googleapis / googleapis/google-cloud-node

Logging stops after google.logging.v2.LoggingServiceV2 timeout

Aperta
#7,585 2 commenti 0 reazioni 0 assegnatari Vedi su GitHub
api: logging priority: p1 size: m type: bug
Lingua principale
TypeScript
Stelle
3.2k
Fork
712
Merge medio
2g 9h
PR unite (30g)
104

Descrizione

#### Environment details

- OS: Ubuntu 20, App Engine
- Node.js version: 20.9.0
- `@google-cloud/logging` version: 10.5.0
- `@grpc/grpc-js` version: 1.8.22
- `google-gax` version: 3.6.1

#### Steps to reproduce

1. Run server on Google App Engine
2. After some number of hours, we see an error in the logging of:
```
GoogleError: Total timeout of API google.logging.v2.LoggingServiceV2 exceeded 60000 milliseconds before any response was received.
at repeat (/app/node_modules/google-gax/src/normalCalls/retries.ts:84:23)
at Timeout._onTimeout (/app/node_modules/google-gax/src/normalCalls/retries.ts:125:13)
at listOnTimeout (node:internal/timers:573:17)
at processTimers (node:internal/timers:514:7) {
```
From this point onwards, no logs from our app are written and visible in the Log Explorer. Notably, followed the steps from https://cloud.google.com/logging/docs/agent/logging/troubleshooting and it seems like fluentd is still alive, as we are able to see traces of later requests in the Log Explorer but no app logging from them.

This seems like the same issue as [617](https://github.com/googleapis/nodejs-logging/issues/617), though in that case upgrading the package versions helped. I have included all the versions I am using at the top.

Is there some way to catch this error and retry logging overall? Seems odd that the logging service dies completely after one failed request.

Guida per i contributori

Apri la guida per i contributori

Direzione di ricerca

Riproduci il fallimento con le versioni indicate di Node.js, @google-cloud/logging, @grpc/grpc-js e google-gax su App Engine. Inizia dal percorso dello stack di retries.ts di google-gax e dal flusso di logging di LoggingServiceV2; chiarisci con i maintainer il comportamento di ripristino previsto. Il lavoro è completato quando un timeout non interrompe permanentemente i log successivi dell’applicazione.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
google-cloud, nodejs, typescript
Ambito
observability
Tipo di issue
Bug
Difficoltà
4/5
Tempo stimato
3-5 giorni
Stato di attività
Ferma
Chiarezza
Da chiarire
Idoneità per principianti
25/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.