release-26.4: roachtest: apt_problem failed

Open
#175,651 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
38/100
Issue type
Bug
Clarity
Needs clarification
Activity status
Active
Tech stack
gcp, go, linux
Domain
cloud, infrastructure, testing

Research direction

Start with the roachtest README and the apt output in run_090129.611664349_n1_sudo-aptget-qq-insta.log under /artifacts/django/cpu_arch=arm64/run_1. Investigate why dependency installation fails after three attempts on the arm64 GCE cluster, comparing the linked failures on other branches. Done means the django roachtest no longer reports apt_problem in this environment.

Written by the indexing model from the issue text.

Description

branch-release-26.4 O-roachtest O-robot T-testeng X-infra-flake

roachtest.apt_problem failed with artifacts on release-26.4 @ b4884d371d74d172ab184bc4ef0924ccb758f3c2:

Failed with:

test django failed: (django.go:70).func1: all attempts failed for install dependencies: full command output in run_090129.611664349_n1_sudo-aptget-qq-insta.log: error persisted after 3 attempts: TRANSIENT_ERROR(apt_problem): exit status 100
test artifacts and logs in: /artifacts/django/cpu_arch=arm64/run_1

Cluster Node to Ip Mapping:

Node Public IP Private IP
teamcity-21523842-1789803587-27-n1cpu16-0001 10.91.96.15

Parameters:

  • arch=arm64
  • cloud=gce
  • coverageBuild=false
  • cpu=16
  • diskCount=0
  • encrypted=false
  • fs=ext4
  • localSSD=true
  • metamorphicLeases=default
  • runtimeAssertionsBuild=false
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

See: Datadog Logs

Same failure on other branches

  • #174976 release-26.2.7-rc: roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.2.7-rc]
  • #174851 basalt-26.3: roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake basalt-green branch-basalt-26.3]
  • #174691 release-26.3.2-rc: roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.3.2-rc]
  • #174466 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]
  • #174341 basalt-26.3: roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake basalt-red branch-basalt-26.3]
  • #173764 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.4.15-rc]
  • #173585 basalt-26.3: roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-basalt-26.3]
  • #173563 release-26.2.6-rc: roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.2.6-rc]
  • #173550 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.2.23-rc]
  • #173460 release-26.3.1-rc: roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-26.3.1-rc]

/cc @cockroachlabs/test-eng

Improve this report!

Jira issue: CRDB-68551

Dominant language
Go
Stars
32.5k
Forks
4.1k
PR metrics pending

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from cockroachdb/cockroach

All issues in cockroachdb/cockroach

Similar issues

More Go issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.