cockroachdb / cockroachdb/cockroach

backup: TestDataDriven_restore_tenants failed

Open
#171,368 2 comments 0 reactions 1 assignee Claimed by @andrew-r-thomas View on GitHub
A-disaster-recovery branch-release-26.1 C-test-failure O-robot P-2 s390x-test-failure T-disaster-recovery
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

backup.TestDataDriven_restore_tenants [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Ci_TestsIbmCloudLinuxS390x_UnitTestsS390x/21368004?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Ci_TestsIbmCloudLinuxS390x_UnitTestsS390x/21368004?buildTab=artifacts#/) on release-26.1 @ [d1acd9efba925395e89856897aad3aac51b67f1f](https://github.com/cockroachdb/cockroach/commits/d1acd9efba925395e89856897aad3aac51b67f1f):

```
created by github.com/cockroachdb/pebble/internal/genericcache.(*shard[...]).Init in goroutine 34797
external/com_github_cockroachdb_pebble/internal/genericcache/shard.go:54 +0x1da

goroutine 41528 [chan receive, 59 minutes]:
github.com/cockroachdb/pebble/internal/genericcache.(*shard[...]).releaseLoop(0x882fc600)
external/com_github_cockroachdb_pebble/internal/genericcache/shard.go:61 +0x80
created by github.com/cockroachdb/pebble/internal/genericcache.(*shard[...]).Init in goroutine 34797
external/com_github_cockroachdb_pebble/internal/genericcache/shard.go:54 +0x1da

goroutine 41505 [select]:
github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs.func1()
pkg/util/admission/work_queue.go:479 +0x1e4
created by github.com/cockroachdb/cockroach/pkg/util/admission.(*WorkQueue).startClosingEpochs in goroutine 34797
pkg/util/admission/work_queue.go:450 +0x84

goroutine 41536 [chan receive, 59 minutes]:
github.com/cockroachdb/pebble/internal/genericcache.(*shard[...]).releaseLoop(0x882fc600)
external/com_github_cockroachdb_pebble/internal/genericcache/shard.go:61 +0x80
created by github.com/cockroachdb/pebble/internal/genericcache.(*shard[...]).Init in goroutine 34797
external/com_github_cockroachdb_pebble/internal/genericcache/shard.go:54 +0x1da

goroutine 41473 [chan receive, 59 minutes]:
github.com/cockroachdb/pebble/internal/genericcache.(*shard[...]).releaseLoop(0x882fc600)
external/com_github_cockroachdb_pebble/internal/genericcache/shard.go:61 +0x80
created by github.com/cockroachdb/pebble/internal/genericcache.(*shard[...]).Init in goroutine 34797
external/com_github_cockroachdb_pebble/internal/genericcache/shard.go:54 +0x1da

goroutine 41529 [chan receive, 59 minutes]:
github.com/cockroachdb/pebble/internal/genericcache.(*shard[...]).releaseLoop(0x882fc600)
external/com_github_cockroachdb_pebble/internal/genericcache/shard.go:61 +0x80
created by github.com/cockroachdb/pebble/internal/genericcache.(*shard[...]).Init in goroutine 34797
external/com_github_cockroachdb_pebble/internal/genericcache/shard.go:54 +0x1da

goroutine 34798 [select, 59 minutes]:
github.com/cockroachdb/cockroach/pkg/util/log.(*fileSink).gcDaemon(0xc00b750000, {0x88246218, 0xc00226c0a0})
pkg/util/log/file_log_gc.go:20 +0x8e
created by github.com/cockroachdb/cockroach/pkg/util/log.ApplyConfig in goroutine 34797
pkg/util/log/flags.go:365 +0x14dc

goroutine 41458 [chan receive, 59 minutes, "pebble":"gc"]:
github.com/cockroachdb/pebble/internal/deletepacer.(*DeletePacer).mainLoop(0xc00aff0508)
external/com_github_cockroachdb_pebble/internal/deletepacer/delete_pacer.go:183 +0x3b2
github.com/cockroachdb/pebble/internal/deletepacer.Open.func1.1({0x88246250, 0xc00d030fc0})
external/com_github_cockroachdb_pebble/internal/deletepacer/delete_pacer.go:108 +0x30
runtime/pprof.Do({0x882459f0, 0x8c3d3340}, {{0xc009ab17c0, 0x1, 0x1}}, 0xc006a15fa8)
GOROOT/src/runtime/pprof/runtime.go:51 +0xc2
github.com/cockroachdb/pebble/internal/deletepacer.Open.func1()
external/com_github_cockroachdb_pebble/internal/deletepacer/delete_pacer.go:107 +0xba
created by github.com/cockroachdb/pebble/internal/deletepacer.Open in goroutine 34797
external/com_github_cockroachdb_pebble/internal/deletepacer/delete_pacer.go:106 +0x29a
```
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

/cc @cockroachdb/disaster-recovery

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*TestDataDriven_restore_tenants.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-64474

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.