matrixorigin / matrixorigin/matrixone

[Bug]: 生产环境 mo logservice 没有重启但是丢失 leader

Open
#27,600 1 comment 0 reactions 1 assignee Claimed by @volgariver6 View on GitHub
kind/bug severity/s0
Dominant language
Go
Stars
1.9k
Forks
311
Avg merge
1d 3h
Merged PRs (30d)
768

Description

### Is there an existing issue for the same bug?

- [x] I have checked the existing issues.

### Branch Name

4.1-dev

### Commit ID

4.1.2

### Other Environment Information

```Markdown
- Hardware parameters:
- OS type:
- Others:
```

### Actual Behavior

关键时间线(CST/北京时间):

- 12:15:25.992 开始出现 get truncated lsn timed out, tick skipped
- 12:16:09.478 开始大量 dragonboat dropped an incoming message
- 12:17:13.150 开始 error: timeout, converted to code 20429
- 12:22:19.442 开始严重的 raft dropped proposal, no leader 风暴
- 该 no-leader/proposal drop 风暴持续到约 14:24
- 16:00-16:11 又有一波尖峰,随后当前三个 pod 在 16:09:29 左右被重建,容器在 16:10:35-16:10:45 启动;当前都是 Running 且 restart 0

[incident-summary.md](https://github.com/user-attachments/files/31424274/incident-summary.md)

[mo-restore-log-onset-all_20260825_1210-1235_CST.log.gz](https://github.com/user-attachments/files/31424276/mo-restore-log-onset-all_20260825_1210-1235_CST.log.gz)

[mo-restore-log-spike_20260825_1555-1620_CST.log.gz](https://github.com/user-attachments/files/31424277/mo-restore-log-spike_20260825_1555-1620_CST.log.gz)

### Expected Behavior

_No response_

### Steps to Reproduce

```Markdown
-
```

### Additional information

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.