cockroachdb / cockroachdb/cockroach

basalt-26.3.2-rc-20260908: kv/kvserver/liveness: TestLivenessRangeGetsPeriodicallyCompacted failed

Open
#175,297 3 comments 0 reactions 1 assignee Claimed by @iskettaneh View on GitHub
A-kv branch-basalt-26.3.2-rc-20260908 C-bug C-test-failure O-robot P-2 T-kv
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

kv/kvserver/liveness.TestLivenessRangeGetsPeriodicallyCompacted [failed](https://mesolite.cluster.engflow.com/invocations/default/3e6250f1-ec23-4556-b888-ca3350756d3b?testReportRun=2&testReportShard=1&testReportAttempt=1#targets-Ly9wa2cva3Yva3ZzZXJ2ZXIvbGl2ZW5lc3M6bGl2ZW5lc3NfdGVzdA==) on basalt-26.3.2-rc-20260908 @ [807558e5e81666af257c811e925e4cae570abc28](https://github.com/cockroachdb/cockroach/commits/807558e5e81666af257c811e925e4cae570abc28):

```
github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
pkg/util/admission/work_queue.go:646 +0x1c9
created by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 91671
pkg/util/admission/work_queue.go:617 +0x8b

goroutine 91672 [select, 39 minutes]:
github.com/cockroachdb/cockroach/pkg/util/log.(*fileSink).gcDaemon(0xc01a52fd10, {0xa3849b8, 0xc027994230})
pkg/util/log/file_log_gc.go:20 +0xd2
created by github.com/cockroachdb/cockroach/pkg/util/log.applyConfigInternal in goroutine 91671
pkg/util/log/flags.go:416 +0x2337

goroutine 91838 [select, 39 minutes]:
github.com/cockroachdb/cockroach/pkg/util/hlc.(*Clock).StartMonitoringForwardClockJumps.func1()
pkg/util/hlc/hlc.go:298 +0x22c
created by github.com/cockroachdb/cockroach/pkg/util/hlc.(*Clock).StartMonitoringForwardClockJumps in goroutine 91671
pkg/util/hlc/hlc.go:290 +0x225

goroutine 95067 [select, 39 minutes]:
database/sql.(*DB).connectionOpener(0xc03048b040, {0xa3849b8, 0xc02500ca00})
GOROOT/src/database/sql/sql.go:1261 +0xed
created by database/sql.OpenDB in goroutine 91671
GOROOT/src/database/sql/sql.go:841 +0x287

goroutine 95922 [sync.Cond.Wait, 39 minutes, "pebble":"wal-sync"]:
sync.runtime_notifyListWait(0xc01f8ea088, 0x0)
GOROOT/src/runtime/sema.go:617 +0x1b3
sync.(*Cond).Wait(0xc01f8ea078)
GOROOT/src/sync/cond.go:71 +0x55
github.com/cockroachdb/pebble/record.(*flusherCond).Wait(...)
external/com_github_cockroachdb_pebble/record/log_writer.go:374
github.com/cockroachdb/pebble/record.(*LogWriter).flushLoop(0xc01f8ea000, {0xc01bf3de60?, 0x9489ec0?})
external/com_github_cockroachdb_pebble/record/log_writer.go:677 +0x1f9
runtime/pprof.Do({0xa384700, 0x11cb9d00}, {{0xc00019ac80?, 0x8e084c0?, 0x7f102253a200?}}, 0xc023954fc0)
GOROOT/src/runtime/pprof/runtime.go:57 +0x112
github.com/cockroachdb/pebble/record.NewLogWriter.func2()
external/com_github_cockroachdb_pebble/record/log_writer.go:591 +0x92
created by github.com/cockroachdb/pebble/record.NewLogWriter in goroutine 95888
external/com_github_cockroachdb_pebble/record/log_writer.go:590 +0x8ff

goroutine 92333 [select]:
github.com/cockroachdb/cockroach/pkg/util/admission.makeStoreWorkQueue.func1()
pkg/util/admission/work_queue.go:2964 +0xe9
created by github.com/cockroachdb/cockroach/pkg/util/admission.makeStoreWorkQueue in goroutine 91671
pkg/util/admission/work_queue.go:2961 +0x791

goroutine 91674 [select, 39 minutes]:
github.com/cockroachdb/cockroach/pkg/util/log.(*fileSink).gcDaemon(0xc01406e0f0, {0xa3849b8, 0xc027994230})
pkg/util/log/file_log_gc.go:20 +0xd2
created by github.com/cockroachdb/cockroach/pkg/util/log.applyConfigInternal in goroutine 91671
pkg/util/log/flags.go:416 +0x2337
```

Parameters:
- attempt=1
- race=true
- run=2
- shard=1
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #173534 kv/kvserver/liveness: TestLivenessRangeGetsPeriodicallyCompacted failed [C-bug C-test-failure O-robot P-2 T-kv branch-master]

/cc @cockroachlabs/kv-triage

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*TestLivenessRangeGetsPeriodicallyCompacted.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.