cockroachdb / cockroachdb/cockroach

server: TestInitHandshake failed

Open
#105,606 8 comments 0 reactions 0 assignees View on GitHub
branch-release-22.2 C-bug O-robot T-kv
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

server.TestInitHandshake [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_StressBazel/10692251?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_StressBazel/10692251?buildTab=artifacts#/) on release-22.2 @ [1a1b737e43d6582a5655722c15ca340dacac5039](https://github.com/cockroachdb/cockroach/commits/1a1b737e43d6582a5655722c15ca340dacac5039):

```
init_handshake_test.go:96: n1: waiting for cert bundle
init_handshake_test.go:96: n2: sending cert bundle to peers
init_handshake_test.go:96: n1: received cert bundle
init_handshake_test.go:122:
Error Trace: github.com/cockroachdb/cockroach/pkg/server/init_handshake_test.go:122
Error: Received unexpected error:
invalid signature in messages from peers; likely due to token mismatch
(1) secondary error attachment
| operation "init handshake" timed out after 10m0s (given timeout 10m0s): error when sending bundle to peers as leader: Post "https://127.0.0.1:40407/deliverBundle/": dial tcp 127.0.0.1:40407: connect: connection refused
| (1) operation "init handshake" timed out after 10m0s (given timeout 10m0s)
| Wraps: (2) attached stack trace
| -- stack trace:
| | github.com/cockroachdb/cockroach/pkg/server.initHandshakeHelper
| | github.com/cockroachdb/cockroach/pkg/server/init_handshake.go:621
| | github.com/cockroachdb/cockroach/pkg/server.InitHandshake.func1
| | github.com/cockroachdb/cockroach/pkg/server/init_handshake.go:667
| | github.com/cockroachdb/cockroach/pkg/util/contextutil.RunWithTimeout
| | github.com/cockroachdb/cockroach/pkg/util/contextutil/context.go:91
| | github.com/cockroachdb/cockroach/pkg/server.InitHandshake
| | github.com/cockroachdb/cockroach/pkg/server/init_handshake.go:665
| | github.com/cockroachdb/cockroach/pkg/server.TestInitHandshake.func6
| | github.com/cockroachdb/cockroach/pkg/server/init_handshake_test.go:104
| | runtime.goexit
| | GOROOT/src/runtime/asm_amd64.s:1594
| Wraps: (3) error when sending bundle to peers as leader
| Wraps: (4) Post "https://127.0.0.1:40407/deliverBundle/"
| Wraps: (5) dial tcp 127.0.0.1:40407
| Wraps: (6) connect
| Wraps: (7) connection refused
| Error types: (1) *contextutil.TimeoutError (2) *withstack.withStack (3) *errutil.withPrefix (4) *url.Error (5) *net.OpError (6) *os.SyscallError (7) syscall.Errno
Wraps: (2) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/server.initHandshakeHelper
| github.com/cockroachdb/cockroach/pkg/server/init_handshake.go:554
| github.com/cockroachdb/cockroach/pkg/server.InitHandshake.func1
| github.com/cockroachdb/cockroach/pkg/server/init_handshake.go:667
| github.com/cockroachdb/cockroach/pkg/util/contextutil.RunWithTimeout
| github.com/cockroachdb/cockroach/pkg/util/contextutil/context.go:91
| github.com/cockroachdb/cockroach/pkg/server.InitHandshake
| github.com/cockroachdb/cockroach/pkg/server/init_handshake.go:665
| github.com/cockroachdb/cockroach/pkg/server.TestInitHandshake.func7
| github.com/cockroachdb/cockroach/pkg/server/init_handshake_test.go:107
| runtime.goexit
| GOROOT/src/runtime/asm_amd64.s:1594
Wraps: (3) invalid signature in messages from peers; likely due to token mismatch
Error types: (1) *secondary.withSecondaryError (2) *withstack.withStack (3) *errutil.leafError
Test: TestInitHandshake
panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestInitHandshake3497407728
--- FAIL: TestInitHandshake (600.06s)
```

Parameters: TAGS=bazel,gss,deadlock


Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

/cc @cockroachdb/kv @cockroachdb/server

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*TestInitHandshake.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/internal/issues)

Jira issue: CRDB-29123

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.