cockroachdb / cockroachdb/cockroach
release-26.4: roachtest: kv50/rangelookups/relocate/nodes=8 failed
Open
Nobody has claimed this yet.
branch-release-26.4
C-test-failure
O-roachtest
O-robot
release-blocker
T-kv
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
roachtest.kv50/rangelookups/relocate/nodes=8 failed with artifacts on release-26.4 @ b4884d371d74d172ab184bc4ef0924ccb758f3c2:
Failed with:
(monitor.go:329).Wait: monitor failure: pq: internal error: range r900:/Table/106/1/49{48002781010004592-66431096767956192} [(n4,s4):74, (n5,s5):73, (n6,s6):69, (n7,s7):75LEARNER, next=76, gen=327, sticky=9223372036.854775807,2147483647] was either in a joint configuration or had learner replicas: (n4,s4):74,(n5,s5):73,(n6,s6):69,(n7,s7):75LEARNER
test artifacts and logs in: /artifacts/kv50/rangelookups/relocate/nodes=8/run_1
Cluster Node to Ip Mapping:
| Node | Public IP | Private IP |
|---|---|---|
| teamcity-21524579-1789881036-04-n9cpu8-0001 | 10.91.97.129 | |
| teamcity-21524579-1789881036-04-n9cpu8-0002 | 10.91.97.132 | |
| teamcity-21524579-1789881036-04-n9cpu8-0003 | 10.91.97.135 | |
| teamcity-21524579-1789881036-04-n9cpu8-0004 | 10.91.97.128 | |
| teamcity-21524579-1789881036-04-n9cpu8-0005 | 10.91.97.136 | |
| teamcity-21524579-1789881036-04-n9cpu8-0006 | 10.91.97.133 | |
| teamcity-21524579-1789881036-04-n9cpu8-0007 | 10.91.97.131 | |
| teamcity-21524579-1789881036-04-n9cpu8-0008 | 10.91.97.130 | |
| teamcity-21524579-1789881036-04-n9cpu8-0009 | 10.91.97.177 |
Parameters:
MetamorphicFilesystem=ext4MetamorphicVolumeType=pd-ssdarch=amd64cloud=gcecoverageBuild=falsecpu=8diskCount=0encrypted=falsefs=ext4localSSD=falsemetamorphicDRPC=truemetamorphicLeases=leadermetamorphicWriteBuffering=trueruntimeAssertionsBuild=false
Jira issue: CRDB-68564
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the linked TeamCity build and artifacts for roachtest kv50/rangelookups/relocate/nodes=8, then read the roachtest README and the linked Grafana and Datadog logs. Investigate the reported learner-replica and joint-configuration failure using the available logs. Done means the cause is understood and this roachtest no longer reports the failure.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- gcp, go
- Domain
- databases, distributed-systems, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100