cockroachdb / cockroachdb/cockroach

pkg/kv/kvserver/asim/asim_test: TestAsimDeterministic failed

Open
#173,337 3 comments 0 reactions 0 assignees View on GitHub
A-testing branch-release-25.4.15-rc C-test-failure O-robot P-3 T-kv X-infra-flake
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

pkg/kv/kvserver/asim/asim_test.TestAsimDeterministic [failed](https://mesolite.cluster.engflow.com/invocations/default/f659c256-88b2-4fef-ad78-c031f78fc2fa?testReportRun=7&testReportShard=1&testReportAttempt=1#targets-Ly9wa2cva3Yva3ZzZXJ2ZXIvYXNpbTphc2ltX3Rlc3Q=) on release-25.4.15-rc @ [256dcc153f29dc89ab41386bc590280ea7ebacf9](https://github.com/cockroachdb/cockroach/commits/256dcc153f29dc89ab41386bc590280ea7ebacf9):

```

goroutine 11 [chan receive, 5 minutes]:
github.com/cockroachdb/cockroach/pkg/util/log.signalFlusher()
pkg/util/log/log_flush.go:147 +0x85
created by github.com/cockroachdb/cockroach/pkg/util/log.init.5 in goroutine 1
pkg/util/log/log_flush.go:79 +0x26

goroutine 13 [syscall]:
os/signal.signal_recv()
GOROOT/src/runtime/sigqueue.go:152 +0x29
os/signal.loop()
GOROOT/src/os/signal/signal_unix.go:23 +0x13
created by os/signal.Notify.func1.1 in goroutine 11
GOROOT/src/os/signal/signal.go:151 +0x1f

goroutine 14 [runnable]:
github.com/cockroachdb/cockroach/pkg/util/goschedstats.init.0.func1()
pkg/util/goschedstats/runnable_enabled.go:144 +0xe5
created by github.com/cockroachdb/cockroach/pkg/util/goschedstats.init.0 in goroutine 1
pkg/util/goschedstats/runnable_enabled.go:136 +0x1a

goroutine 101 [runnable]:
github.com/cockroachdb/cockroach/pkg/kv/kvserver/replicastats.(*ReplicaStats).AverageRatePerSecond(0xc002b48f00?, {0x100000000000000?, 0x7?, 0x0?})
pkg/kv/kvserver/replicastats/replica_stats.go:341 +0x22
github.com/cockroachdb/cockroach/pkg/kv/kvserver/load.(*ReplicaLoad).getLocked(0xc002b3e460, 0x5)
pkg/kv/kvserver/load/replica_load.go:183 +0x55
github.com/cockroachdb/cockroach/pkg/kv/kvserver/load.(*ReplicaLoad).Stats(0xc002b3e460)
pkg/kv/kvserver/load/replica_load.go:200 +0x13d
github.com/cockroachdb/cockroach/pkg/kv/kvserver/asim/state.(*ReplicaLoadCounter).Load(0xc00282b950)
pkg/kv/kvserver/asim/state/load.go:80 +0x5f
github.com/cockroachdb/cockroach/pkg/kv/kvserver/asim/state.(*state).RangeUsageInfo(0xc00381e0e0, 0x64, 0x3)
pkg/kv/kvserver/asim/state/impl.go:1102 +0xc6
github.com/cockroachdb/cockroach/pkg/kv/kvserver/asim/state.(*state).capacity(_, _)
pkg/kv/kvserver/asim/state/impl.go:288 +0x17b
github.com/cockroachdb/cockroach/pkg/kv/kvserver/asim/state.(*state).updateStoreCapacity(0xc00381e0e0, 0x3)
pkg/kv/kvserver/asim/state/impl.go:255 +0x6c
github.com/cockroachdb/cockroach/pkg/kv/kvserver/asim/state.(*state).StoreDescriptors(0xc00381e0e0, 0x0, {0xc000283c80, 0x15, 0xed9ca54a2?})
pkg/kv/kvserver/asim/state/impl.go:245 +0x111
github.com/cockroachdb/cockroach/pkg/kv/kvserver/asim/metrics.(*Tracker).Tick(0xc002480a00, {0x3027228, 0xc00780afa0}, {0x3063938?, 0xc00381e0e0?, 0x0?}, {0x3063938, 0xc00381e0e0})
pkg/kv/kvserver/asim/metrics/tracker.go:136 +0x1ea
github.com/cockroachdb/cockroach/pkg/kv/kvserver/asim.(*Simulator).tickMetrics(...)
pkg/kv/kvserver/asim/asim.go:405
github.com/cockroachdb/cockroach/pkg/kv/kvserver/asim.(*Simulator).RunSim(0xc002a5ac80, {0x3026c58?, 0x4e44b40?})
pkg/kv/kvserver/asim/asim.go:287 +0x350
pkg/kv/kvserver/asim/asim_test_test.TestAsimDeterministic(0xc000584000)
pkg/kv/kvserver/asim/asim_test.go:80 +0x1f0
testing.tRunner(0xc000584000, 0x2d26748)
GOROOT/src/testing/testing.go:1690 +0xf4
created by testing.(*T).Run in goroutine 1
GOROOT/src/testing/testing.go:1743 +0x390
```

Parameters:
- attempt=1
- run=7
- shard=1
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

/cc @cockroachlabs/kv-triage @cockroachlabs/kv-triage

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*TestAsimDeterministic.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Contributor guide

Open the contributing guide

Research direction

Start by reproducing pkg/kv/kvserver/asim/asim_test.TestAsimDeterministic and inspect the stack through asim.go, metrics/tracker.go, state/impl.go, state/load.go, load/replica_load.go, and replicastats/replica_stats.go. Determine why the deterministic test fails or stalls on release-25.4.15-rc, then verify that the test completes successfully and remains deterministic.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
distributed-systems, testing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.