temporalio / temporalio/temporal

Add retries for Temporal having connectivity failures for persistence database

Open
#7,577 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Go
Stars
23.2k
Forks
1.9k
Avg merge
2d 8h
Merged PRs (30d)
228

Description

Temporal server needs to retry transient 5xx errors from visibility datastore especially when it fails to acquire database connections temporarily.

I tried raising database resources such as CPU, memory but it didn't help.

It's the same error as reported in this

https://github.com/pingcap/tidb/issues/52653

Or somehow expose connectAttributes and the variable "connect_timeout=XYZ" in temporal server configuration

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are named. Start by tracing Temporal's visibility datastore handling for transient 5xx errors and read the linked TiDB issue; done when the requested retry behavior or connection-timeout configuration is defined and verified for temporary database connection failures.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
backend, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.