cockroachdb / cockroachdb/cockroach
pkg/sql/tests: potential performance regression
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
pkg/sql/tests [performance regression](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachprodMicrobenchmarkWeeklyWip/20911487?buildTab=log) on master @ [2b0948f73804d08c7e0fe12a5151b54770831c8f](https://github.com/cockroachdb/cockroach/commits/2b0948f73804d08c7e0fe12a5151b54770831c8f):
Performance regressions detected in package pkg/sql
Comparison: v25.4.2 (2c80e22e) -> refs/heads/master (2b0948f7)
Found 60 benchmark(s) with regressions ≥20%:
- [pkg/sql/tests→KV/Delete/SQL/rows=10000-32 (sec/op): +209.27% (209.3%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=KV/Delete/SQL/rows=10000-32&package=pkg/sql/tests)
- [pkg/sql/catalog/resolver→ResolveExistingObject/in_schema,_implicit-32 (sec/op): +69.10% (69.1%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ResolveExistingObject/in_schema,_implicit-32&package=pkg/sql/catalog/resolver)
- [pkg/sql/tests→KV/Delete/SQL/rows=1000-32 (sec/op): +50.56% (50.6%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=KV/Delete/SQL/rows=1000-32&package=pkg/sql/tests)
- [pkg/sql/schemachanger/rel→ReverseLinkedListNoRel/lists=512,depth=16-32 (sec/op): +33.11% (33.1%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ReverseLinkedListNoRel/lists=512,depth=16-32&package=pkg/sql/schemachanger/rel)
- [pkg/sql/schemachanger/rel→ReverseLinkedListNoRel/lists=8192,depth=4-32 (sec/op): +30.79% (30.8%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ReverseLinkedListNoRel/lists=8192,depth=4-32&package=pkg/sql/schemachanger/rel)
- [pkg/sql/sem/tree→ParseJSON/escape=0.00%/262144-32 (sec/op): +28.59% (28.6%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParseJSON/escape=0.00%/262144-32&package=pkg/sql/sem/tree)
- [pkg/sql/sem/tree→ParseJSON/escape=0.00%/524288-32 (sec/op): +28.28% (28.3%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParseJSON/escape=0.00%/524288-32&package=pkg/sql/sem/tree)
- [pkg/sql/schemachanger/rel→ReverseLinkedListNoRel/lists=512,depth=1-32 (sec/op): +27.89% (27.9%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ReverseLinkedListNoRel/lists=512,depth=1-32&package=pkg/sql/schemachanger/rel)
- [pkg/sql/schemachanger/rel→ReverseLinkedListNoRel/lists=2048,depth=16-32 (sec/op): +26.72% (26.7%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ReverseLinkedListNoRel/lists=2048,depth=16-32&package=pkg/sql/schemachanger/rel)
- [pkg/sql/schemachanger/rel→ReverseLinkedListNoRel/lists=8192,depth=16-32 (sec/op): +25.37% (25.4%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ReverseLinkedListNoRel/lists=8192,depth=16-32&package=pkg/sql/schemachanger/rel)
- [pkg/sql/schemachanger/rel→ReverseLinkedListNoRel/lists=8192,depth=1-32 (sec/op): +25.16% (25.2%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ReverseLinkedListNoRel/lists=8192,depth=1-32&package=pkg/sql/schemachanger/rel)
- [pkg/sql/schemachanger/rel→ReverseLinkedListNoRel/lists=128,depth=16-32 (sec/op): +24.85% (24.8%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ReverseLinkedListNoRel/lists=128,depth=16-32&package=pkg/sql/schemachanger/rel)
- [pkg/sql/sem/tree→ParseJSON/escape=0.00%/16384-32 (sec/op): +23.77% (23.8%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParseJSON/escape=0.00%/16384-32&package=pkg/sql/sem/tree)
- [pkg/sql/schemachanger/rel→ReverseLinkedListNoRel/lists=2048,depth=4-32 (sec/op): +23.30% (23.3%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ReverseLinkedListNoRel/lists=2048,depth=4-32&package=pkg/sql/schemachanger/rel)
- [pkg/sql/schemachanger/rel→ReverseLinkedListNoRel/lists=512,depth=4-32 (sec/op): +21.27% (21.3%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ReverseLinkedListNoRel/lists=512,depth=4-32&package=pkg/sql/schemachanger/rel)
- [pkg/sql/rowcontainer→NumberedContainerIteratorCaching/inverted-join/matchRatio=1/repeatAccesses=8/mem=11000/numbered-32 (sec/op): +20.99% (21.0%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=NumberedContainerIteratorCaching/inverted-join/matchRatio=1/repeatAccesses=8/mem=11000/numbered-32&package=pkg/sql/rowcontainer)
- [pkg/sql/rowcontainer→NumberedContainerIteratorCaching/inverted-join/matchRatio=1/repeatAccesses=8/mem=2560000/numbered-32 (sec/op): +20.14% (20.1%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=NumberedContainerIteratorCaching/inverted-join/matchRatio=1/repeatAccesses=8/mem=2560000/numbered-32&package=pkg/sql/rowcontainer)
- [pkg/sql/rowcontainer→NumberedContainerIteratorCaching/inverted-join/matchRatio=1/repeatAccesses=4/mem=102400/numbered-32 (sec/op): +20.03% (20.0%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=NumberedContainerIteratorCaching/inverted-join/matchRatio=1/repeatAccesses=4/mem=102400/numbered-32&package=pkg/sql/rowcontainer)
- [pkg/sql/tests→KV/Delete/SQL/rows=10000-32 (allocs/op): +138.24% (138.2%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=KV/Delete/SQL/rows=10000-32&package=pkg/sql/tests)
- [pkg/sql/catalog/resolver→ResolveExistingObject/in_schema,_implicit-32 (allocs/op): +108.89% (108.9%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ResolveExistingObject/in_schema,_implicit-32&package=pkg/sql/catalog/resolver)
- [pkg/sql/tests→KV/Delete/SQL/rows=1000-32 (allocs/op): +46.82% (46.8%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=KV/Delete/SQL/rows=1000-32&package=pkg/sql/tests)
- [pkg/sql/tests→Sysbench/KV/3node/oltp_read_only-32 (allocs/op): +36.60% (36.6%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/KV/3node/oltp_read_only-32&package=pkg/sql/tests)
- [pkg/sql/rowflow→Router/MIRROR/outputs=8-32 (allocs/op): +29.17% (29.2%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Router/MIRROR/outputs=8-32&package=pkg/sql/rowflow)
- [pkg/sql/tests→Sysbench/KV/3node/oltp_point_select-32 (allocs/op): +27.93% (27.9%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/KV/3node/oltp_point_select-32&package=pkg/sql/tests)
- [pkg/sql/tests→ParallelSysbench/KV/1node_remote/oltp_point_select-32 (allocs/op): +23.53% (23.5%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParallelSysbench/KV/1node_remote/oltp_point_select-32&package=pkg/sql/tests)
- [pkg/sql/tests→ParallelSysbench/KV/3node/oltp_point_select-32 (allocs/op): +23.53% (23.5%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParallelSysbench/KV/3node/oltp_point_select-32&package=pkg/sql/tests)
- [pkg/sql/tests→Sysbench/KV/1node_remote/oltp_point_select-32 (allocs/op): +22.64% (22.6%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/KV/1node_remote/oltp_point_select-32&package=pkg/sql/tests)
- [pkg/sql/sem/tree→ParseJSON/escape=0.00%/524288-32 (B/s): -22.01% (22.0%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParseJSON/escape=0.00%/524288-32&package=pkg/sql/sem/tree)
- [pkg/sql/sem/tree→ParseJSON/escape=0.00%/262144-32 (B/s): -21.69% (21.7%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParseJSON/escape=0.00%/262144-32&package=pkg/sql/sem/tree)
- [pkg/sql/tests→KV/Delete/SQL/rows=10000-32 (B/op): +109.39% (109.4%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=KV/Delete/SQL/rows=10000-32&package=pkg/sql/tests)
- [pkg/sql/catalog/resolver→ResolveExistingObject/in_schema,_implicit-32 (B/op): +101.32% (101.3%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ResolveExistingObject/in_schema,_implicit-32&package=pkg/sql/catalog/resolver)
- [pkg/sql/tests→Sysbench/KV/3node/oltp_read_only-32 (B/op): +42.88% (42.9%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/KV/3node/oltp_read_only-32&package=pkg/sql/tests)
- [pkg/sql/tests→Sysbench/KV/3node/oltp_point_select-32 (B/op): +38.92% (38.9%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/KV/3node/oltp_point_select-32&package=pkg/sql/tests)
- [pkg/sql/tests→ParallelSysbench/KV/1node_remote/oltp_read_only-32 (B/op): +37.46% (37.5%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParallelSysbench/KV/1node_remote/oltp_read_only-32&package=pkg/sql/tests)
- [pkg/sql/tests→Sysbench/KV/1node_remote/oltp_read_only-32 (B/op): +37.40% (37.4%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/KV/1node_remote/oltp_read_only-32&package=pkg/sql/tests)
- [pkg/sql/tests→ParallelSysbench/KV/1node_remote/oltp_point_select-32 (B/op): +36.19% (36.2%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParallelSysbench/KV/1node_remote/oltp_point_select-32&package=pkg/sql/tests)
- [pkg/sql/tests→ParallelSysbench/KV/3node/oltp_read_only-32 (B/op): +36.18% (36.2%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParallelSysbench/KV/3node/oltp_read_only-32&package=pkg/sql/tests)
- [pkg/sql/tests→Sysbench/KV/3node/oltp_write_only-32 (B/op): +35.46% (35.5%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/KV/3node/oltp_write_only-32&package=pkg/sql/tests)
- [pkg/sql/tests→KV/Delete/SQL/rows=1000-32 (B/op): +35.28% (35.3%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=KV/Delete/SQL/rows=1000-32&package=pkg/sql/tests)
- [pkg/sql/tests→Sysbench/KV/1node_remote/oltp_point_select-32 (B/op): +34.18% (34.2%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/KV/1node_remote/oltp_point_select-32&package=pkg/sql/tests)
- [pkg/sql/tests→ParallelSysbench/KV/3node/oltp_point_select-32 (B/op): +33.41% (33.4%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParallelSysbench/KV/3node/oltp_point_select-32&package=pkg/sql/tests)
- [pkg/sql/rowexec→OrderedDistinct/rows=65536-32 (B/op): +33.33% (33.3%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=OrderedDistinct/rows=65536-32&package=pkg/sql/rowexec)
- [pkg/sql/rowexec→PartiallyOrderedDistinct/rows=65536-32 (B/op): +33.33% (33.3%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=PartiallyOrderedDistinct/rows=65536-32&package=pkg/sql/rowexec)
- [pkg/sql/rowexec→OrderedDistinct/rows=4096-32 (B/op): +33.24% (33.2%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=OrderedDistinct/rows=4096-32&package=pkg/sql/rowexec)
- [pkg/sql/rowexec→PartiallyOrderedDistinct/rows=4096-32 (B/op): +33.22% (33.2%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=PartiallyOrderedDistinct/rows=4096-32&package=pkg/sql/rowexec)
- [pkg/sql/tests→ParallelSysbench/KV/1node_remote/oltp_read_write-32 (B/op): +32.83% (32.8%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParallelSysbench/KV/1node_remote/oltp_read_write-32&package=pkg/sql/tests)
- [pkg/sql/tests→Sysbench/KV/1node_remote/oltp_read_write-32 (B/op): +32.32% (32.3%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/KV/1node_remote/oltp_read_write-32&package=pkg/sql/tests)
- [pkg/sql/rowexec→OrderedDistinct/rows=256-32 (B/op): +31.94% (31.9%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=OrderedDistinct/rows=256-32&package=pkg/sql/rowexec)
- [pkg/sql/tests→Sysbench/SQL/1node_remote/oltp_point_select-32 (B/op): +31.80% (31.8%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/SQL/1node_remote/oltp_point_select-32&package=pkg/sql/tests)
- [pkg/sql/rowexec→PartiallyOrderedDistinct/rows=256-32 (B/op): +31.62% (31.6%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=PartiallyOrderedDistinct/rows=256-32&package=pkg/sql/rowexec)
- [pkg/sql/rowflow→Router/MIRROR/outputs=8-32 (B/op): +30.01% (30.0%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Router/MIRROR/outputs=8-32&package=pkg/sql/rowflow)
- [pkg/sql/tests→ParallelSysbench/KV/3node/oltp_read_write-32 (B/op): +28.77% (28.8%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParallelSysbench/KV/3node/oltp_read_write-32&package=pkg/sql/tests)
- [pkg/sql/rowexec→UnorderedDistinct/rows=65536-32 (B/op): +28.34% (28.3%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=UnorderedDistinct/rows=65536-32&package=pkg/sql/rowexec)
- [pkg/sql/rowexec→UnorderedDistinct/rows=4096-32 (B/op): +25.01% (25.0%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=UnorderedDistinct/rows=4096-32&package=pkg/sql/rowexec)
- [pkg/sql/rowcontainer→NumberedContainerIteratorCaching/lookup-join/matchRatio=4/repeatAccesses=2/mem=102400/numbered-32 (B/op): +23.86% (23.9%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=NumberedContainerIteratorCaching/lookup-join/matchRatio=4/repeatAccesses=2/mem=102400/numbered-32&package=pkg/sql/rowcontainer)
- [pkg/sql/tests→Sysbench/SQL/3node/oltp_read_only-32 (B/op): +23.10% (23.1%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/SQL/3node/oltp_read_only-32&package=pkg/sql/tests)
- [pkg/sql/tests→Sysbench/SQL/1node_remote/oltp_read_only-32 (B/op): +22.28% (22.3%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=Sysbench/SQL/1node_remote/oltp_read_only-32&package=pkg/sql/tests)
- [pkg/sql/rowexec→UnorderedDistinct/rows=256-32 (B/op): +22.16% (22.2%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=UnorderedDistinct/rows=256-32&package=pkg/sql/rowexec)
- [pkg/sql/tests→ParallelSysbench/SQL/1node_remote/oltp_read_only-32 (B/op): +21.65% (21.7%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParallelSysbench/SQL/1node_remote/oltp_read_only-32&package=pkg/sql/tests)
- [pkg/sql/tests→ParallelSysbench/SQL/3node/oltp_read_only-32 (B/op): +20.70% (20.7%)](https://microbench.testeng.crdb.io/dashboard/?benchmark=ParallelSysbench/SQL/3node/oltp_read_only-32&package=pkg/sql/tests)
Help
See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)
Jira issue: CRDB-58261
Contributor guide
Assessment
This issue has not been assessed yet.