cockroachdb / cockroachdb/cockroach

kv/kvserver: TestLogGrowthWhenRefreshingPendingCommands failed

Closed
#158,047 3 comments 0 reactions 0 assignees View on GitHub
branch-release-25.4.0-rc C-test-failure O-robot P-3 T-db-server
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

kv/kvserver.TestLogGrowthWhenRefreshingPendingCommands [failed](https://mesolite.cluster.engflow.com/invocations/default/9a6535a6-a8b1-4ff9-874b-94179c131411?testReportRun=2&testReportShard=14&testReportAttempt=1#targets-Ly9wa2cva3Yva3ZzZXJ2ZXI6a3ZzZXJ2ZXJfdGVzdA==) on release-25.4.0-rc @ [4f4179243a351bc48c00dd9243dc56b8af98e210](https://github.com/cockroachdb/cockroach/commits/4f4179243a351bc48c00dd9243dc56b8af98e210):

```
=== RUN TestLogGrowthWhenRefreshingPendingCommands
test_log_scope.go:171: test logs captured to: outputs.zip/logTestLogGrowthWhenRefreshingPendingCommands4096739981
test_log_scope.go:82: use -show-logs to present logs inline
client_raft_test.go:2032: -- test log scope end --
test logs left over in: outputs.zip/logTestLogGrowthWhenRefreshingPendingCommands4096739981
--- FAIL: TestLogGrowthWhenRefreshingPendingCommands (169.41s)
=== RUN TestLogGrowthWhenRefreshingPendingCommands/lease-type=LeaseLeader
--- FAIL: TestLogGrowthWhenRefreshingPendingCommands/lease-type=LeaseLeader (55.66s)
=== RUN TestLogGrowthWhenRefreshingPendingCommands/lease-type=LeaseLeader/proposeOnFollower=true
test_server_shim.go:561: DRPC is enabled (override by TestingGlobalDRPCOption)
client_raft_test.go:2002: raft leader should be node 0, but got status {"id":"1","term":6,"vote":"1","commit":229,"lead":"0","leadEpoch":"0","raftState":"StateFollower","applied":229,"progress":{},"leadtransferee":"0"}
--- FAIL: TestLogGrowthWhenRefreshingPendingCommands/lease-type=LeaseLeader/proposeOnFollower=true (28.86s)
```

Parameters:
- attempt=1
- race=true
- run=2
- shard=14
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #154843 kv/kvserver: TestLogGrowthWhenRefreshingPendingCommands failed [C-test-failure O-robot P-3 T-db-server branch-release-25.4]

/cc @cockroachdb/kv-triage

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*TestLogGrowthWhenRefreshingPendingCommands.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-57079

Contributor guide

Open the contributing guide

Research direction

The failure is in kv/kvserver.TestLogGrowthWhenRefreshingPendingCommands, with the reported assertion in client_raft_test.go. Start by reproducing the race-enabled test on release-25.4.0-rc and inspect the captured logs at outputs.zip/logTestLogGrowthWhenRefreshingPendingCommands4096739981. Done means the test no longer reports the wrong Raft leader in the shown lease and proposal case.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
databases, distributed-systems, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.