cockroachdb / cockroachdb/cockroach

kv/kvnemesis: TestKVNemesisRangeFlush failed

Đang mở
#175,502 0 bình luận 0 reaction 0 người được giao Xem trên GitHub
branch-master C-test-failure O-robot release-blocker T-kv
Ngôn ngữ chính
Go
Star
32.5k
Fork
4.1k
Chỉ số merge pull request
Chỉ số pull request đang chờ

Mô tả

kv/kvnemesis.TestKVNemesisRangeFlush [failed](https://mesolite.cluster.engflow.com/invocations/default/f6a30e6f-f185-406f-b3e7-4a2e2cbd6dfb?testReportRun=2&testReportShard=1&testReportAttempt=1#targets-Ly9wa2cva3Yva3ZuZW1lc2lzOmt2bmVtZXNpc190ZXN0) on master @ [b112dc518c826da8b4b577934d4ab5c0c24da045](https://github.com/cockroachdb/cockroach/commits/b112dc518c826da8b4b577934d4ab5c0c24da045):

```
=== RUN TestKVNemesisRangeFlush
test_log_scope.go:172: test logs captured to: outputs.zip/logTestKVNemesisRangeFlush31330368
test_log_scope.go:82: use -show-logs to present logs inline
kvnemesis_test.go:914: seed: 83315178612643042
kvnemesis_test.go:346: n1 using clock[offset=-123.277µs,amp=3.376723ms]
kvnemesis_test.go:346: n2 using clock[offset=296.87µs,amp=3.20313ms]
kvnemesis_test.go:346: n3 using clock[offset=103.397µs,amp=3.396603ms]
test_server_shim.go:146: using test tenant configuration from testserver factory defaults
kvnemesis_test.go:429: kvnemesis logging to /mnt/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/testlogs/pkg/kv/kvnemesis/kvnemesis_test/run_2_of_10/test.outputs/kvnemesis3286149345
kvnemesis.go:241: error applying env.RSEngineController.RangeFlushForKey(tk(9973107197308248818)) // flushing SSTables during RangeFlush: pebble: compaction cancelled by a concurrent operation, will retry compaction: flushing SSTables during RangeFlush: pebble: compaction cancelled by a concurrent operation, will retry compaction
kvnemesis.go:282: failures(verbose): /mnt/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/testlogs/pkg/kv/kvnemesis/kvnemesis_test/run_2_of_10/test.outputs/kvnemesis3286149345/failures
repro steps: /mnt/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/testlogs/pkg/kv/kvnemesis/kvnemesis_test/run_2_of_10/test.outputs/kvnemesis3286149345/repro.go
rangefeed KVs: /mnt/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/testlogs/pkg/kv/kvnemesis/kvnemesis_test/run_2_of_10/test.outputs/kvnemesis3286149345/kvs-rangefeed.txt
scan KVs: /mnt/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/testlogs/pkg/kv/kvnemesis/kvnemesis_test/run_2_of_10/test.outputs/kvnemesis3286149345/kvs-scan.txt
kvnemesis_test.go:1102: Metric | Node 1 | Node 2 | Node 3
kvnemesis_test.go:1108: ------------------------------------+--------------------------------+--------------------------------+-------------------------------
kvnemesis_test.go:1115: follower_reads.success_count | 2 | 0 | 1
kvnemesis_test.go:1115: raft.commands.proposed | 2820 | 157 | 66
kvnemesis_test.go:1115: raft.commands.reproposed.new-lai | 3 | 1 | 0
kvnemesis_test.go:1115: raft.commands.reproposed.unchanged | 132 | 4 | 2
kvnemesis_test.go:1115: txn.aborts | 14 | 2 | 15
kvnemesis_test.go:1115: txn.commits | 614 | 110 | 109
kvnemesis_test.go:1115: txn.durations | μ=7ms p50=3ms p99=67ms | μ=4ms p50=2ms p99=55ms | μ=24ms p50=3ms p99=302ms
kvnemesis_test.go:1115: txn.restarts.writetooold | 2 | 0 | 0
kvnemesis_test.go:1115: txn.write_buffering.disabled_after_buffering | 0 | 0 | 0
kvnemesis_test.go:1115: distsender.rpc.err.writeintenterrtype | 1 | 0 | 3
kvnemesis_test.go:1115: txn.restarts.serializable | 1 | 0 | 0
kvnemesis_test.go:1115: txn.restarts.readwithinuncertainty | 0 | 0 | 0
kvnemesis_test.go:1115: txn.restarts.commitdeadlineexceeded | 0 | 0 | 0
kvnemesis_test.go:1115: txn.server_side.1PC.success | 56 | 0 | 0
kvnemesis_test.go:1115: txnrecovery.failures | 0 | 0 | 0
kvnemesis_test.go:1115: txnrecovery.successes.aborted | 0 | 0 | 0
kvnemesis_test.go:1115: txnrecovery.successes.committed | 0 | 0 | 0
kvnemesis_test.go:1115: txnwaitqueue.deadlocks_total | 0 | 0 | 0
kvnemesis_test.go:988:
Error Trace: pkg/kv/kvnemesis/kvnemesis_test.go:988
pkg/kv/kvnemesis/kvnemesis_test.go:893
Error: Should be zero, but was 1
Test: TestKVNemesisRangeFlush
Messages: kvnemesis detected failures
dump_raft_logs.go:32: dumping raft logs to /mnt/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/testlogs/pkg/kv/kvnemesis/kvnemesis_test/run_2_of_10/test.outputs/kvnemesis3286149345/raftlogs
panic.go:694: -- test log scope end --
test logs left over in: outputs.zip/logTestKVNemesisRangeFlush31330368
--- FAIL: TestKVNemesisRangeFlush (22.68s)
```

Parameters:
- attempt=1
- run=2
- shard=1
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)

Same failure on other branches

- #175500 basalt-26.3.2-rc-20260908: kv/kvnemesis: TestKVNemesisRangeFlush failed [C-test-failure O-robot T-kv branch-basalt-26.3.2-rc-20260908 release-blocker]
- #175404 basalt-26.3.2-rc-20260913: kv/kvnemesis: TestKVNemesisRangeFlush failed [A-kv C-bug C-test-failure O-robot P-2 T-kv branch-basalt-26.3.2-rc-20260913]

/cc @cockroachlabs/kv-triage

[Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-68419

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.