agent-substrate / agent-substrate/substrate

Improve retry logic in atenet when resuming actors

Aperta
#1,562 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub
area/api area/api-machinery area/network kind/design
Lingua principale
Go
Stelle
1.8k
Fork
316
Merge medio
2g 43m
PR unite (30g)
287

Descrizione

The atenet is deciding when to retry a `ResumeActor` call just by looking at the gRPC status. It always retries `Aborted`, and retries `ResourceExhausted`, `FailedPrecondition` and and `Unavailable` if request parking is enabled.

The main issue with this approach is that the gRPC status codes are not granular enough to distinguish errors that should be retried from errors that shouldn't. For example, today we keep retrying `ResumeActor` calls on actors in `CRASHED` state.

I think we need a better contract so that downstream consumers of the API (e.g. atenet) can accurately decide whether to safely retry or not. One option we could consider is attaching the `RetryInfo`[1] proto in the status details.

FYI @bowei @LiorLieberman

[1]: https://pkg.go.dev/google.golang.org/genproto/googleapis/rpc/errdetails#RetryInfo

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.