cockroachdb / cockroachdb/cockroach

pkg/sql/logictest/tests/fakedist-disk/fakedist-disk_test: TestLogic_row_level_security failed

Open
#173,866 2 comments 0 reactions 0 assignees View on GitHub
branch-master C-test-failure O-robot T-sql-queries
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

pkg/sql/logictest/tests/fakedist-disk/fakedist-disk_test.TestLogic_row_level_security [failed](https://mesolite.cluster.engflow.com/invocations/default/ed47ea57-3af7-461d-9332-bd61fe08af53?testReportRun=3&testReportShard=27&testReportAttempt=1#targets-Ly9wa2cvc3FsL2xvZ2ljdGVzdC90ZXN0cy9mYWtlZGlzdC1kaXNrOmZha2VkaXN0LWRpc2tfdGVzdA==) on master @ [889c09024fa5aea5b9c994899ac2fc0da6f3a62d](https://github.com/cockroachdb/cockroach/commits/889c09024fa5aea5b9c994899ac2fc0da6f3a62d):

```
sync.(*Cond).Wait(0xc060de4600)
GOROOT/src/sync/cond.go:71 +0x55
github.com/cockroachdb/cockroach/pkg/sql/colflow.(*routerOutputOp).Next(0xc05266d1e0)
pkg/sql/colflow/routers.go:248 +0x12b
github.com/cockroachdb/cockroach/pkg/sql/colexec.(*invariantsChecker).Next(0xc059eaca50)
pkg/sql/colexec/invariants_checker.go:99 +0x254
github.com/cockroachdb/cockroach/pkg/sql/colexec.(*ParallelUnorderedSynchronizer).Init.func1.3()
pkg/sql/colexec/parallel_unordered_synchronizer.go:297 +0x46
github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError(0xc056630060)
pkg/sql/colexecerror/error.go:162 +0x79
github.com/cockroachdb/cockroach/pkg/sql/colexec.(*ParallelUnorderedSynchronizer).workerRun(0xc041769cc0, {{0xc7f3e18, 0xc059eaca50}, {0x0, 0x0, 0x0}, {0xc03b9d3b30, 0x1, 0x1}}, 0x2)
pkg/sql/colexec/parallel_unordered_synchronizer.go:356 +0x3e5
github.com/cockroachdb/cockroach/pkg/sql/colexec.(*ParallelUnorderedSynchronizer).Init.func1({0xc7edcd8, 0xc04eaa9720}, 0x2)
pkg/sql/colexec/parallel_unordered_synchronizer.go:299 +0x72d
created by github.com/cockroachdb/cockroach/pkg/sql/colexec.(*ParallelUnorderedSynchronizer).Init in goroutine 3748670
pkg/sql/colexec/parallel_unordered_synchronizer.go:269 +0xd9

goroutine 3748829 [select, "distsql.appname":"$ internal-count-sessions-holding-stale-descriptor", "distsql.gateway":"1", "distsql.stmt":"SELECT count(DISTINCT l1.session_id) FROM system.lease AS l1 WHERE (((l1.desc_id = _) AND (l1.version < _)) AND crdb_internal.sql_liveness_is_alive(l1.session_id, _)) AND (NOT EXISTS (SELECT _ FROM system.lease AS l2 WHERE ((l2.desc_id = l1.desc_id) AND (l2.session_id = l1.session_id)) AND (l2.version = _)))", "distsql.txn":"213dedc7-1d6b-4233-9472-6b27227f4ce0", "f":"3698a685", "n":"2"]:
google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc034b4e690, {0xc041718970, 0x5, 0x5})
external/org_golang_google_grpc/internal/transport/transport.go:195 +0x130
google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc034b4e690, {0xc041718970, 0x5, 0x5})
external/org_golang_google_grpc/internal/transport/transport.go:175 +0x35b
google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc041718900, {0xc041718970, 0x5, 0x5})
external/org_golang_google_grpc/internal/transport/transport.go:514 +0x62
io.ReadAtLeast({0xc7965a0, 0xc041718900}, {0xc041718970, 0x5, 0x5}, 0x5)
GOROOT/src/io/io.go:335 +0xd1
io.ReadFull(...)
GOROOT/src/io/io.go:354
google.golang.org/grpc/internal/transport.(*Stream).Read(0xc023be79e0, {0xc041718970, 0x5, 0x5})
external/org_golang_google_grpc/internal/transport/transport.go:498 +0x11f
google.golang.org/grpc.(*parser).recvMsg(0xc041718960, 0x7fffffff)
external/org_golang_google_grpc/rpc_util.go:600 +0x6a
google.golang.org/grpc.recvAndDecompress(0xc041718960, 0xc023be79e0, {0x0, 0x0}, 0x7fffffff, 0xc0375b9b60, {0xc7cd5f0, 0x15220180})
external/org_golang_google_grpc/rpc_util.go:730 +0x7c
google.golang.org/grpc.recv(0xc041718960, {0x7f2a1a09af68, 0xc0014f2ab0}, 0xc023be79e0, {0x0, 0x0}, {0xbf6fe80, 0xc02e7c3e90}, 0x7fffffff, 0xc0375b9b60, ...)
external/org_golang_google_grpc/rpc_util.go:796 +0xc8
google.golang.org/grpc.(*csAttempt).recvMsg(0xc04fddc8f0, {0xbf6fe80, 0xc02e7c3e90}, 0x0)
external/org_golang_google_grpc/stream.go:1080 +0x52e
google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc04fddc8f0)
external/org_golang_google_grpc/stream.go:917 +0x51
google.golang.org/grpc.(*clientStream).withRetry(0xc023be7560, 0xc0375b9e80, 0xc0375b9e70)
external/org_golang_google_grpc/stream.go:752 +0x439
google.golang.org/grpc.(*clientStream).RecvMsg(0xc023be7560, {0xbf6fe80, 0xc02e7c3e90})
external/org_golang_google_grpc/stream.go:916 +0x1df
github.com/cockroachdb/cockroach/pkg/sql/execinfrapb.(*distSQLFlowStreamClient).Recv(0xc01fee60d0)
bazel-out/k8-fastbuild/bin/pkg/sql/execinfrapb/execinfrapb_go_proto_/github.com/cockroachdb/cockroach/pkg/sql/execinfrapb/api.pb.go:576 +0x66
github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc.(*Outbox).runWithStream.func3()
pkg/sql/colflow/colrpc/outbox.go:443 +0x88
created by github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc.(*Outbox).runWithStream in goroutine 3748794
pkg/sql/colflow/colrpc/outbox.go:427 +0x29a
```

Parameters:
- attempt=1
- race=true
- run=3
- shard=27
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

[Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-67162

Contributor guide

Open the contributing guide

Research direction

Start with pkg/sql/logictest/tests/fakedist-disk/fakedist-disk_test and reproduce TestLogic_row_level_security using the reported race=true, run=3, and shard=27 parameters. Inspect the stack entries in pkg/sql/colflow/routers.go, pkg/sql/colexec/invariants_checker.go, and pkg/sql/colexec/parallel_unordered_synchronizer.go. Done means identifying and fixing the hang or failure so the test completes successfully and reliably.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, sql
Domain
databases, distributed-systems, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.