cockroachdb / cockroachdb/cockroach

ccl/sqlproxyccl: TestProxyProtocol failed

Open
#170,712 2 comments 0 reactions 0 assignees View on GitHub
branch-release-26.1.5-rc C-test-failure O-robot T-cloud-platform
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

ccl/sqlproxyccl.TestProxyProtocol [failed](https://mesolite.cluster.engflow.com/invocations/default/3b1cdce7-8d90-47f3-951b-73b1011885ee?testReportRun=3&testReportShard=3&testReportAttempt=1#targets-Ly9wa2cvY2NsL3NxbHByb3h5Y2NsOnNxbHByb3h5Y2NsX3Rlc3Q=) on release-26.1.5-rc @ [5d80eb1d1ea91cfe92aa79ea3fdd28c1aedda0d4](https://github.com/cockroachdb/cockroach/commits/5d80eb1d1ea91cfe92aa79ea3fdd28c1aedda0d4):

```
runtime.gopark(0xc0097b7f50?, 0x2?, 0x50?, 0x7d?, 0xc0097b7eb4?)
GOROOT/src/runtime/proc.go:669 +0xce fp=0xc0097b7d10 sp=0xc0097b7cf0 pc=0x4f3bae
runtime.selectgo(0xc0097b7f50, 0xc0097b7eb0, 0x2aca950?, 0x0, 0x2aca950?, 0x1)
GOROOT/src/runtime/select.go:351 +0x9d7 fp=0xc0097b7e80 sp=0xc0097b7d10 pc=0x4cea17
google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc0033c13e0, {0xd5400e0, 0xc001d46370})
external/org_golang_google_grpc/internal/grpcsync/callback_serializer.go:83 +0x1ec fp=0xc0097b7fa0 sp=0xc0097b7e80 pc=0x11322cc
google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer.gowrap1()
external/org_golang_google_grpc/internal/grpcsync/callback_serializer.go:55 +0x50 fp=0xc0097b7fe0 sp=0xc0097b7fa0 pc=0x1131ef0
runtime.goexit({})
src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0097b7fe8 sp=0xc0097b7fe0 pc=0x4fd241
created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 6248
external/org_golang_google_grpc/internal/grpcsync/callback_serializer.go:55 +0x245

goroutine 6257 gp=0xc00573a5a0 m=nil [select]:
runtime.gopark(0xc0088172d8?, 0x2?, 0xa0?, 0xa5?, 0xc0088171d4?)
GOROOT/src/runtime/proc.go:669 +0xce fp=0xc008817030 sp=0xc008817010 pc=0x4f3bae
runtime.selectgo(0xc0088172d8, 0xc0088171d0, 0x3533373534353739?, 0x0, 0x6d69745f64616572?, 0x1)
GOROOT/src/runtime/select.go:351 +0x9d7 fp=0xc0088171a0 sp=0xc008817030 pc=0x4cea17
google.golang.org/grpc.(*pickerWrapper).pick(0xc0020011d0, {0xd540118, 0xc0020015c0}, 0x1, {{0xbea9e66?, 0x47c660?}, {0xd540118?, 0xc0020015c0?}})
external/org_golang_google_grpc/picker_wrapper.go:113 +0x1cc fp=0xc0088173b8 sp=0xc0088171a0 pc=0x121552c
google.golang.org/grpc.(*ClientConn).getTransport(0xc005ca9c08, {0xd540118, 0xc0020015c0}, 0x1, {0xbea9e66, 0x35})
external/org_golang_google_grpc/clientconn.go:1127 +0xab fp=0xc008817448 sp=0xc0088173b8 pc=0x120bcab
google.golang.org/grpc.(*csAttempt).getTransport(0xc009ee45b0)
external/org_golang_google_grpc/stream.go:458 +0x135 fp=0xc008817500 sp=0xc008817448 pc=0x1237815
google.golang.org/grpc.newClientStreamWithParams.func2(0xc009ee45b0)
external/org_golang_google_grpc/stream.go:341 +0x34 fp=0xc008817540 sp=0xc008817500 pc=0x12364d4
google.golang.org/grpc.(*clientStream).withRetry(0xc008e41440, 0xc0023970e0, 0xc008817780)
external/org_golang_google_grpc/stream.go:768 +0x16f fp=0xc0088175f0 sp=0xc008817540 pc=0x123992f
google.golang.org/grpc.newClientStreamWithParams({0xd5400e0, 0xc001d46cd0}, 0x12304e40, 0xc005ca9c08, {0xbea9e66, 0x35}, {0x0, 0x0, 0x0, 0x0, ...}, ...)
external/org_golang_google_grpc/stream.go:353 +0x174a fp=0xc008817878 sp=0xc0088175f0 pc=0x1235bca
google.golang.org/grpc.newClientStream.func2({0xd5400e0, 0xc001d46cd0}, 0xc1649b8)
external/org_golang_google_grpc/stream.go:210 +0x192 fp=0xc008817998 sp=0xc008817878 pc=0x1234352
google.golang.org/grpc.newClientStream({0xd5400e0, 0xc001d46cd0}, 0x12304e40, 0xc005ca9c08, {0xbea9e66, 0x35}, {0x0, 0x0, 0x0})
external/org_golang_google_grpc/stream.go:245 +0xa57 fp=0xc008817b40 sp=0xc008817998 pc=0x12337d7
google.golang.org/grpc.(*ClientConn).NewStream(0xc005ca9c08, {0xd5400e0, 0xc001d46cd0}, 0x12304e40, {0xbea9e66, 0x35}, {0x0, 0x0, 0x0})
external/org_golang_google_grpc/stream.go:170 +0x407 fp=0xc008817c68 sp=0xc008817b40 pc=0x1232b27
github.com/cockroachdb/cockroach/pkg/ccl/sqlproxyccl/tenant.(*directoryClient).WatchPods(0xc0052589d8, {0xd5400e0, 0xc001d46cd0}, 0x139e4dc0, {0x0, 0x0, 0x0})
bazel-out/k8-fastbuild/bin/pkg/ccl/sqlproxyccl/tenant/tenant_go_proto_/github.com/cockroachdb/cockroach/pkg/ccl/sqlproxyccl/tenant/directory.pb.go:705 +0xe5 fp=0xc008817d10 sp=0xc008817c68 pc=0x32d21c5
github.com/cockroachdb/cockroach/pkg/ccl/sqlproxyccl/tenant.(*grpcDirectoryClientAdapter).WatchPods(0xc0052589d8, {0xd5400e0, 0xc001d46cd0}, 0x139e4dc0)
bazel-out/k8-fastbuild/bin/pkg/ccl/sqlproxyccl/tenant/tenant_go_proto_/github.com/cockroachdb/cockroach/pkg/ccl/sqlproxyccl/tenant/directory_drpc.pb.go:408 +0x57 fp=0xc008817d78 sp=0xc008817d10 pc=0x32dfe77
github.com/cockroachdb/cockroach/pkg/ccl/sqlproxyccl/tenant.(*directoryCache).watchPods.func1({0xd5400e0, 0xc009ecb900})
pkg/ccl/sqlproxyccl/tenant/directory_cache.go:394 +0x1e3 fp=0xc008817f08 sp=0xc008817d78 pc=0x32e1c03
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func1({0xd5400e0, 0xc009ecb900})
pkg/util/stop/stopper.go:447 +0x112 fp=0xc008817fa8 sp=0xc008817f08 pc=0x2acd932
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.gowrap1()
pkg/util/stop/stopper.go:448 +0x50 fp=0xc008817fe0 sp=0xc008817fa8 pc=0x2acd7f0
runtime.goexit({})
src/runtime/asm_amd64.s:1693 +0x1 fp=0xc008817fe8 sp=0xc008817fe0 pc=0x4fd241
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 6248
pkg/util/stop/stopper.go:445 +0x247
```

Parameters:
- attempt=1
- race=true
- run=3
- shard=3
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #164811 ccl/sqlproxyccl: TestProxyProtocol failed [C-test-failure O-robot T-cloud-platform branch-release-26.1.1-rc s390x-test-failure]

/cc @cockroachdb/sqlproxy-prs

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*TestProxyProtocol.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-64136

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.