cockroachdb / cockroachdb/cockroach

release-26.3: pkg/kv/followerreads/followerreads_test: TestBoundedStalenessDataDriven failed

Open
#172,519 2 comments 0 reactions 1 assignee Claimed by @stevendanna View on GitHub
A-testing branch-release-26.3 C-bug C-test-failure O-robot P-3 T-kv
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

pkg/kv/followerreads/followerreads_test.TestBoundedStalenessDataDriven [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Ci_TestsAwsLinuxArm64_UnitTests/21422791?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Ci_TestsAwsLinuxArm64_UnitTests/21422791?buildTab=artifacts#/) on release-26.3 @ [b60f2917c1a560facb9bf0946c197e036334658c](https://github.com/cockroachdb/cockroach/commits/b60f2917c1a560facb9bf0946c197e036334658c):

```
boundedstaleness_test.go:418: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b4c6b77bb1c4afd2098de9e97c144fb/logTestBoundedStalenessDataDriven1955802688
--- FAIL: TestBoundedStalenessDataDriven (15.87s)
=== RUN TestBoundedStalenessDataDriven/single_row
test_server_shim.go:168: automatically injected a shared process virtual cluster under test; see comment at top of test_server_shim.go for details.
boundedstaleness_test.go:285:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/19666/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/kv/followerreads/followerreads_test_/followerreads_test.runfiles/com_github_cockroachdb_cockroach/pkg/kv/followerreads/testdata/boundedstaleness/single_row:5:
exec-system-tenant
SET CLUSTER SETTING kv.closed_timestamp.target_duration = '1s';
----
boundedstaleness_test.go:285:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/19666/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/kv/followerreads/followerreads_test_/followerreads_test.runfiles/com_github_cockroachdb_cockroach/pkg/kv/followerreads/testdata/boundedstaleness/single_row:9:
exec
CREATE TABLE t(pk INT PRIMARY KEY) WITH (schema_locked = false);
INSERT INTO t VALUES (1);
----
boundedstaleness_test.go:285:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/19666/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/kv/followerreads/followerreads_test_/followerreads_test.runfiles/com_github_cockroachdb_cockroach/pkg/kv/followerreads/testdata/boundedstaleness/single_row:16:
exec
ALTER RANGE RELOCATE LEASE TO 1 FOR SELECT range_id FROM [SHOW RANGES FROM TABLE t];
----
boundedstaleness_test.go:285:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/19666/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/kv/followerreads/followerreads_test_/followerreads_test.runfiles/com_github_cockroachdb_cockroach/pkg/kv/followerreads/testdata/boundedstaleness/single_row:21:
query ignore-events
SELECT DISTINCT(lease_holder) FROM [SHOW RANGES FROM TABLE t WITH DETAILS];
----
1
boundedstaleness_test.go:285:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/19666/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/kv/followerreads/followerreads_test_/followerreads_test.runfiles/com_github_cockroachdb_cockroach/pkg/kv/followerreads/testdata/boundedstaleness/single_row:30:
query idx=2 wait-until-match
SELECT * FROM t AS OF SYSTEM TIME with_max_staleness('1μs') WHERE pk = 1
----
1
events (1 found):
* event 1: colbatchscan trace on node_idx 2: local read then remote leaseholder read
boundedstaleness_test.go:285:
/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/19666/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/kv/followerreads/followerreads_test_/followerreads_test.runfiles/com_github_cockroachdb_cockroach/pkg/kv/followerreads/testdata/boundedstaleness/single_row:37:
query idx=2
SELECT * FROM t AS OF SYSTEM TIME with_min_timestamp(now() - '1μs') WHERE pk = 1

expected:
1
events (1 found):
* event 1: colbatchscan trace on node_idx 2: local read then remote leaseholder read

found:
1
events (1 found):
* event 1: colbatchscan trace on node_idx 2: local read
--- FAIL: TestBoundedStalenessDataDriven/single_row (15.84s)
```
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #171687 pkg/kv/followerreads/followerreads_test: TestBoundedStalenessDataDriven failed [C-test-failure O-robot P-3 T-kv branch-master]

/cc @cockroachlabs/unowned

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*TestBoundedStalenessDataDriven.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-65767

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.