cockroachdb / cockroachdb/cockroach
bench/rttanalysis: TestMultiRegionBenchmarkExpectation failed
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
bench/rttanalysis.TestMultiRegionBenchmarkExpectation [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Ci_TestsAwsLinuxArm64_UnitTests/21483529?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Ci_TestsAwsLinuxArm64_UnitTests/21483529?buildTab=artifacts#/) on master @ [929ab0955af5c33992bca0ca09adfff32d2de8be](https://github.com/cockroachdb/cockroach/commits/929ab0955af5c33992bca0ca09adfff32d2de8be):
```
=== RUN TestMultiRegionBenchmarkExpectation
validate_benchmark_data.go:191: [/home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/19995/execroot/com_github_cockroachdb_cockroach/bazel-out/aarch64-fastbuild/bin/pkg/bench/rttanalysis/rttanalysis_test_/rttanalysis_test.runfiles/com_github_cockroachdb_cockroach/pkg/bench/rttanalysis/rttanalysis_test_/rttanalysis_test --test.v=test2json --test.run=^TestMultiRegionBenchmarkExpectation$ --test.bench=^$]
I260825 22:53:55.315214 1 (gostd) rand.go:288 [-] 1 random seed: -1849270478099138731
=== RUN TestMultiRegionBenchmarkExpectation
test_log_scope.go:172: test logs captured to: /artifacts/tmp/_tmp/b03b0378e25aebc8fcd368039859e7a0/logTestMultiRegionBenchmarkExpectation2865202499
test_log_scope.go:82: use -show-logs to present logs inline
validate_benchmark_data.go:120: success: expected AlterTableLocality/alter_from_rbr_to_regional_by_table to perform KV lookups in [11, 11], got 12
validate_benchmark_data.go:120: success: expected AlterTableLocality/alter_from_rbr_to_global to perform KV lookups in [11, 11], got 12
validate_benchmark_data.go:120: success: expected AlterRegions/alter_populated_database_add_region to perform KV lookups in [12, 13], got 12
validate_benchmark_data.go:120: success: expected AlterPrimaryRegion/alter_populated_database_alter_primary_region to perform KV lookups in [12, 15], got 14
validate_benchmark_data.go:120: success: expected AlterTableLocality/alter_from_global_to_regional_by_table to perform KV lookups in [9, 10], got 9
validate_benchmark_data.go:120: success: expected AlterPrimaryRegion/alter_empty_database_alter_primary_region to perform KV lookups in [12, 14], got 13
validate_benchmark_data.go:120: success: expected AlterPrimaryRegion/alter_empty_database_set_initial_primary_region to perform KV lookups in [15, 16], got 15
validate_benchmark_data.go:120: success: expected AlterTableLocality/alter_from_regional_by_table_to_rbr to perform KV lookups in [13, 13], got 14
validate_benchmark_data.go:120: success: expected AlterPrimaryRegion/alter_populated_database_set_initial_primary_region to perform KV lookups in [17, 18], got 17
validate_benchmark_data.go:120: success: expected AlterTableLocality/alter_from_global_to_rbr to perform KV lookups in [13, 13], got 14
validate_benchmark_data.go:120: success: expected AlterRegions/alter_empty_database_drop_region to perform KV lookups in [12, 16], got 14
validate_benchmark_data.go:120: success: expected AlterRegions/alter_empty_database_add_region to perform KV lookups in [11, 11], got 11
validate_benchmark_data.go:120: success: expected AlterSurvivalGoals/alter_populated_database_from_zone_to_region to perform KV lookups in [23, 24], got 23
validate_benchmark_data.go:120: success: expected MultiRegionVirtualTableQueries/select_from_crdb_internal.zones_(10_tables) to perform KV lookups in [10, 13], got 11
validate_benchmark_data.go:120: success: expected AlterSurvivalGoals/alter_empty_database_from_region_to_zone to perform KV lookups in [12, 12], got 12
validate_benchmark_data.go:120: success: expected AlterSurvivalGoals/alter_empty_database_from_zone_to_region to perform KV lookups in [11, 19], got 12
validate_benchmark_data.go:120: success: expected MultiRegionVirtualTableQueries/select_from_crdb_internal.zones_(100_tables) to perform KV lookups in [10, 13], got 10
validate_benchmark_data.go:120: success: expected AlterTableLocality/alter_from_regional_by_table_to_global to perform KV lookups in [9, 10], got 9
validate_benchmark_data.go:120: success: expected MultiRegionVirtualTableQueries/select_from_crdb_internal.zones_(50_tables) to perform KV lookups in [10, 13], got 10
validate_benchmark_data.go:120: success: expected AlterRegions/alter_populated_database_drop_region to perform KV lookups in [14, 17], got 15
validate_benchmark_data.go:73: see the -rewrite flag to re-run the benchmarks and adjust the expectations
validate_benchmark_data.go:74: usage: ./dev test --rewrite pkg/bench/rttanalysis -f=TestBenchmarkExpectation/ --test-args '-rewrite-iterations=N'
validate_benchmark_data.go:107: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/b03b0378e25aebc8fcd368039859e7a0/logTestMultiRegionBenchmarkExpectation2865202499
--- FAIL: TestMultiRegionBenchmarkExpectation (298.09s)
--- FAIL: TestMultiRegionBenchmarkExpectation (300.60s)
=== RUN TestMultiRegionBenchmarkExpectation/AlterSurvivalGoals/alter_populated_database_from_region_to_zone
test_server_shim.go:95: cluster virtualization disabled due to issue: #156308 (expected label: C-test-failure)
rtt_analysis_bench.go:168: error executing query="\nBEGIN; CREATE DATABASE test PRIMARY REGION \"us-east1\" REGIONS \"us-east1\", \"us-east2\", \"us-east3\"; COMMIT;\nUSE test;\nCREATE TABLE test11 (p int) LOCALITY REGIONAL BY TABLE IN \"us-east1\";\nCREATE TABLE test12 (p int) LOCALITY REGIONAL BY TABLE IN \"us-east1\";\nCREATE TABLE test21 (p int) LOCALITY REGIONAL BY ROW;\nCREATE TABLE test22 (p int) LOCALITY REGIONAL BY ROW;\nCREATE TABLE test23 (p int) LOCALITY REGIONAL BY ROW;\nCREATE TABLE test24 (p int) LOCALITY REGIONAL BY ROW;\nCREATE TABLE test31 (p int) LOCALITY GLOBAL;\nCREATE TABLE test32 (p int) LOCALITY GLOBAL;\nCREATE TABLE test41 (p int) LOCALITY REGIONAL BY TABLE IN \"us-east2\";\nCREATE TABLE test42 (p int) LOCALITY REGIONAL BY TABLE IN \"us-east2\";\n\nALTER DATABASE test SURVIVE REGION FAILURE" args=[]: pq: attempting to update zone configuration for database test which contains modified field "num_replicas" (expected=5 actual=nil)
HINT: to proceed with the overwrite, SET override_multi_region_zone_config = true, and reissue the statement
DETAIL: the attempted operation will overwrite a user modified field
--- FAIL: TestMultiRegionBenchmarkExpectation/AlterSurvivalGoals/alter_populated_database_from_region_to_zone (130.24s)
=== RUN TestMultiRegionBenchmarkExpectation/AlterSurvivalGoals
--- FAIL: TestMultiRegionBenchmarkExpectation/AlterSurvivalGoals (221.84s)
```
Help
See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)
/cc @cockroachlabs/sql-foundations
[Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)
Jira issue: CRDB-67186
Contributor guide
Assessment
This issue has not been assessed yet.