cockroachdb / cockroachdb/cockroach

release-26.4: roachtest: replicagc-changed-peers/restart=false failed

Open
#175,688 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

branch-release-26.4 C-test-failure O-roachtest O-robot release-blocker T-kv
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

roachtest.replicagc-changed-peers/restart=false failed with artifacts on release-26.4 @ b4884d371d74d172ab184bc4ef0924ccb758f3c2:

Failed with:

(replicagc.go:337).waitForZeroReplicasOnN3: pq: could not determine data type of placeholder $1
test artifacts and logs in: /artifacts/replicagc-changed-peers/restart=false/run_1

Cluster Node to Ip Mapping:

Node Public IP Private IP
teamcity-21524579-1789881036-75-n6cpu4-0001 10.91.99.105
teamcity-21524579-1789881036-75-n6cpu4-0002 10.91.101.183
teamcity-21524579-1789881036-75-n6cpu4-0003 10.91.101.185
teamcity-21524579-1789881036-75-n6cpu4-0004 10.91.101.184
teamcity-21524579-1789881036-75-n6cpu4-0005 10.91.97.85
teamcity-21524579-1789881036-75-n6cpu4-0006 10.91.96.106

Parameters:

  • arch=amd64
  • cloud=gce
  • coverageBuild=false
  • cpu=4
  • diskCount=0
  • encrypted=false
  • fs=ext4
  • localSSD=true
  • metamorphicDRPC=true
  • metamorphicLeases=leader
  • runtimeAssertionsBuild=false
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

See: Datadog Logs

Same failure on other branches

  • #175681 roachtest: replicagc-changed-peers/restart=false failed [C-test-failure O-roachtest O-robot T-kv branch-master release-blocker]
  • #171810 release-26.3: roachtest: replicagc-changed-peers/restart=false failed [A-testing B-runtime-assertions-enabled C-bug C-test-failure O-roachtest O-robot P-3 T-kv branch-release-26.3]

/cc @cockroachlabs/kv-triage

Improve this report!

Jira issue: CRDB-68574

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with replicagc.go at line 337 and inspect the failing waitForZeroReplicasOnN3 call, then review the linked TeamCity log and artifacts for replicagc-changed-peers/restart=false. Compare the same failure on the linked branches and verify that the roachtest completes without the placeholder data-type error.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
databases, distributed-systems, testing-qa
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.