cockroachdb / cockroachdb/cockroach

roachtest: apt_problem failed

Open
#147,485 0 comments 0 reactions 0 assignees View on GitHub
branch-release-25.2.1-rc O-roachtest O-robot T-testeng X-infra-flake
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

roachtest.apt_problem [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/19807896?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/19807896?buildTab=artifacts#/jepsen/bank-multitable/split) on release-25.2.1-rc @ [893b4a9651bdf5c05e1884db8956e312f91d7075](https://github.com/cockroachdb/cockroach/commits/893b4a9651bdf5c05e1884db8956e312f91d7075):

```
test jepsen/bank-multitable/split failed: (cluster.go:2508).Run: full command output in run_102650.092125822_n1-6_sh-c-sudo-DEBIANFRON.log: error persisted after 3 attempts: TRANSIENT_ERROR(apt_problem): exit status 100
test artifacts and logs in: /artifacts/jepsen/bank-multitable/split/run_1
```

Parameters:
- arch=amd64
- cloud=gce
- coverageBuild=false
- cpu=4
- encrypted=false
- fs=ext4
- localSSD=true
- metamorphicBufferedSender=false
- metamorphicLeases=default
- runtimeAssertionsBuild=false
- ssd=0
Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

See: [Grafana](https://go.crdb.dev/roachtest-grafana/teamcity-19807896/jepsen-bank-multitable-split/1748514353516/1748514786429)

Same failure on other branches

- #147484 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1.19-rc]
- #147482 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.3.14-rc]
- #147481 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.26-rc]
- #139470 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.1]
- #133528 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.3]
- #133525 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.2]
- #132737 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1]
- #132063 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.2.4-rc]
- #126897 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2]
- #124052 roachtest: apt_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

/cc @cockroachdb/test-eng

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*apt_problem.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-51078

Contributor guide

Open the contributing guide

Research direction

Start with the roachtest README and the TeamCity log and artifacts linked in the report, especially run_102650.092125822_n1-6_sh-c-sudo-DEBIANFRON.log. Compare this failure with the related apt_problem issues listed for other branches. Done means identifying the cause of the apt exit status 100 and verifying that the roachtest no longer fails for this problem.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
devops, infrastructure, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.