cockroachdb / cockroachdb/cockroach

basalt-26.3: kv/kvserver/gc: TestEndToEndGC failed

Open
#174,874 3 comments 0 reactions 1 assignee Claimed by @pav-kv View on GitHub
branch-basalt-26.3 C-test-failure O-robot T-kv X-duplicate
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

kv/kvserver/gc.TestEndToEndGC [failed](https://mesolite.cluster.engflow.com/invocations/default/d239d62a-5965-4976-9f91-d90c819f20c9?testReportRun=1&testReportShard=1&testReportAttempt=1#targets-Ly9wa2cva3Yva3ZzZXJ2ZXIvZ2M6Z2NfdGVzdA==) on basalt-26.3 @ [017b84cd0101b832a6ee0c1934d073d108d0b24a](https://github.com/cockroachdb/cockroach/commits/017b84cd0101b832a6ee0c1934d073d108d0b24a):

```
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*rangefeedMuxer).establishMuxConnection.Group.GoCtx.func2()
pkg/util/ctxgroup/ctxgroup.go:200 +0x116
golang.org/x/sync/errgroup.(*Group).Go.func1()
external/org_golang_x_sync/errgroup/errgroup.go:93 +0x87
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 189162
external/org_golang_x_sync/errgroup/errgroup.go:78 +0x11d

goroutine 182769 [select, 28 minutes]:
github.com/cockroachdb/cockroach/pkg/util/tracing.(*Tracer).runPeriodicSnapshotsLoop(0xc014eccf00, 0xc012c80000, 0xc012bb13b0, 0xc00200e000, 0x0)
pkg/util/tracing/tracer_snapshots.go:279 +0x1a6
github.com/cockroachdb/cockroach/pkg/util/tracing.(*Tracer).PeriodicSnapshotsLoop(0xc014eccf00, 0xc012c80000, 0xc00200e000)
pkg/util/tracing/tracer_snapshots.go:245 +0xf7
github.com/cockroachdb/cockroach/pkg/server.newSQLServer.func1({0xc015c8a140?, 0xa3c8350?})
pkg/server/server_sql.go:574 +0xe5
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func1({0xa3c8350, 0xc0152240a0})
pkg/util/stop/stopper.go:447 +0x113
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 182733
pkg/util/stop/stopper.go:445 +0x247

goroutine 366373 [runnable]:
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.gowrap1()
pkg/util/stop/stopper.go:445
runtime.goexit({})
src/runtime/asm_amd64.s:1771 +0x1
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 183316
pkg/util/stop/stopper.go:445 +0x247

goroutine 182750 [select]:
github.com/cockroachdb/cockroach/pkg/gossip.(*infoStore).launchCallbackWorker.func1({0xc001446240?, 0xa3c8350?})
pkg/gossip/infostore.go:293 +0x55e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func1({0xa3c8350, 0xc0152240a0})
pkg/util/stop/stopper.go:447 +0x113
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 182733
pkg/util/stop/stopper.go:445 +0x247

goroutine 182748 [select]:
github.com/cockroachdb/cockroach/pkg/gossip.(*infoStore).launchCallbackWorker.func1({0xc024d67d80?, 0xa3c8350?})
pkg/gossip/infostore.go:293 +0x55e
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func1({0xa3c8350, 0xc0152240a0})
pkg/util/stop/stopper.go:447 +0x113
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 182733
pkg/util/stop/stopper.go:445 +0x247

goroutine 184011 [select]:
github.com/cockroachdb/cockroach/pkg/sql/sqlstats/sslocal.(*SQLStatsIngester).Start.func2({0xc01634ae40?, 0xa3c7c30?})
pkg/sql/sqlstats/sslocal/sql_stats_ingestor.go:242 +0x112
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func1({0xa3c7c30, 0xc01a4a80f0})
pkg/util/stop/stopper.go:447 +0x113
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 182733
pkg/util/stop/stopper.go:445 +0x247
```

Parameters:
- attempt=1
- race=true
- run=1
- shard=1
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

/cc @cockroachlabs/kv-triage

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*TestEndToEndGC.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-68059

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.