cockroachdb / cockroachdb/cockroach

bench/rttanalysis: TestBenchmarkExpectationShard1 failed

Open
#167,268 4 comments 0 reactions 1 assignee Claimed by @msbutler View on GitHub
A-jobs branch-master C-test-failure O-robot T-jobs
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

bench/rttanalysis.TestBenchmarkExpectationShard1 [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Ci_TestsAwsLinuxArm64_UnitTests/21293100?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Ci_TestsAwsLinuxArm64_UnitTests/21293100?buildTab=artifacts#/) on master @ [cc1040617836359ffc8d6c16f95914f14b6461cc](https://github.com/cockroachdb/cockroach/commits/cc1040617836359ffc8d6c16f95914f14b6461cc):

```
=== RUN TestBenchmarkExpectationShard1
test_log_scope.go:172: test logs captured to: /artifacts/tmp/_tmp/f690f21fc45bbac50e6b9f2c778c2a02/logTestBenchmarkExpectationShard12547543743
test_log_scope.go:82: use -show-logs to present logs inline
validate_benchmark_data.go:120: success: expected SystemDatabaseQueries/select_system.users_with_schema_Name to perform KV lookups in [1, 1], got 1
validate_benchmark_data.go:120: success: expected SystemDatabaseQueries/select_system.users_with_empty_database_Name to perform KV lookups in [1, 1], got 1
validate_benchmark_data.go:120: success: expected SystemDatabaseQueries/select_system.users_without_schema_Name to perform KV lookups in [1, 1], got 1
validate_benchmark_data.go:120: success: expected AlterRole/alter_role_with_2_options to perform KV lookups in [15, 15], got 15
validate_benchmark_data.go:120: success: expected CreateRole/create_role_with_1_option to perform KV lookups in [13, 13], got 13
validate_benchmark_data.go:120: success: expected DropTable/drop_1_table to perform KV lookups in [13, 13], got 13
validate_benchmark_data.go:120: success: expected CreateRole/create_role_with_2_options to perform KV lookups in [16, 16], got 16
validate_benchmark_data.go:120: success: expected CreateRole/create_role_with_3_options to perform KV lookups in [19, 19], got 19
validate_benchmark_data.go:120: success: expected CreateRole/create_role_with_no_options to perform KV lookups in [14, 14], got 14
validate_benchmark_data.go:117: fail: expected AlterRole/alter_role_with_3_options to perform KV lookups in [19, 19], got 31
validate_benchmark_data.go:120: success: expected VirtualTableQueries/select_crdb_internal.tables_with_1_fk to perform KV lookups in [1, 1], got 1
validate_benchmark_data.go:120: success: expected DropTable/drop_2_tables to perform KV lookups in [15, 15], got 15
validate_benchmark_data.go:120: success: expected DropTable/drop_3_tables to perform KV lookups in [17, 17], got 17
validate_benchmark_data.go:120: success: expected AlterRole/alter_role_with_1_option to perform KV lookups in [12, 12], got 12
validate_benchmark_data.go:120: success: expected AlterTableDropColumn/alter_table_drop_3_columns to perform KV lookups in [23, 23], got 22
validate_benchmark_data.go:120: success: expected VirtualTableQueries/virtual_table_cache_with_point_lookups to perform KV lookups in [5, 5], got 5
validate_benchmark_data.go:120: success: expected AlterTableDropColumn/alter_table_drop_1_column to perform KV lookups in [23, 23], got 22
validate_benchmark_data.go:120: success: expected VirtualTableQueries/select_crdb_internal.invalid_objects_with_1_fk to perform KV lookups in [2, 2], got 2
validate_benchmark_data.go:120: success: expected Jobs/resume_job to perform KV lookups in [9, 12], got 9
validate_benchmark_data.go:120: success: expected AlterTableDropColumn/alter_table_drop_2_columns to perform KV lookups in [23, 23], got 22
validate_benchmark_data.go:120: success: expected Jobs/show_job to perform KV lookups in [3, 3], got 3
validate_benchmark_data.go:120: success: expected VirtualTableQueries/capture_index_usage_stats to perform KV lookups in [3, 3], got 3
validate_benchmark_data.go:120: success: expected Jobs/cancel_job to perform KV lookups in [9, 12], got 9
validate_benchmark_data.go:120: success: expected Jobs/pause_job to perform KV lookups in [3, 3], got 3
validate_benchmark_data.go:120: success: expected Jobs/jobs_page_type_filtered_no_matches to perform KV lookups in [1, 3], got 1
validate_benchmark_data.go:120: success: expected Jobs/crdb_internal.system_jobs to perform KV lookups in [3, 3], got 3
validate_benchmark_data.go:120: success: expected Jobs/show_jobs to perform KV lookups in [3, 5], got 3
validate_benchmark_data.go:120: success: expected VirtualTableQueries/virtual_table_cache_with_schema_change to perform KV lookups in [10, 10], got 10
validate_benchmark_data.go:120: success: expected Jobs/jobs_page_type_filtered to perform KV lookups in [3, 3], got 3
validate_benchmark_data.go:120: success: expected Jobs/jobs_page_latest_50 to perform KV lookups in [3, 3], got 3
validate_benchmark_data.go:120: success: expected Jobs/jobs_page_default to perform KV lookups in [3, 5], got 3
validate_benchmark_data.go:120: success: expected VirtualTableQueries/show_create_all_routines to perform KV lookups in [0, 0], got 0
validate_benchmark_data.go:120: success: expected Jobs/non_admin_crdb_internal.system_jobs to perform KV lookups in [2, 2], got 2
validate_benchmark_data.go:120: success: expected Jobs/non_admin_show_jobs to perform KV lookups in [2, 2], got 2
validate_benchmark_data.go:120: success: expected VirtualTableQueries/show_create_all_triggers to perform KV lookups in [0, 0], got 0
validate_benchmark_data.go:73: see the -rewrite flag to re-run the benchmarks and adjust the expectations
validate_benchmark_data.go:74: usage: ./dev test --rewrite pkg/bench/rttanalysis -f=TestBenchmarkExpectation/ --test-args '-rewrite-iterations=N'
validate_benchmark_data.go:107: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/f690f21fc45bbac50e6b9f2c778c2a02/logTestBenchmarkExpectationShard12547543743
--- FAIL: TestBenchmarkExpectationShard1 (497.27s)
--- FAIL: TestBenchmarkExpectationShard1 (498.66s)
=== RUN TestBenchmarkExpectationShard1/AlterRole
--- FAIL: TestBenchmarkExpectationShard1/AlterRole (351.31s)
=== RUN TestBenchmarkExpectationShard1/AlterRole/alter_role_with_3_options
rtt_analysis_bench.go:224: AlterRole/alter_role_with_3_options: got 31.5, expected 19
rtt_analysis_bench.go:230: wrote jaeger trace to /artifacts/tmp/_tmp/f690f21fc45bbac50e6b9f2c778c2a02/logTestBenchmarkExpectationShard12547543743/AlterRole_alter_role_with_3_options.jaeger.json
--- FAIL: TestBenchmarkExpectationShard1/AlterRole/alter_role_with_3_options (337.44s)
```
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

/cc @cockroachdb/sql-foundations

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*TestBenchmarkExpectationShard1.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-62360

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.