roachtest: schemachange/bulkingest/nodes=12/rows=4000000000/elastic=false/create_index failed

roachtest.schemachange/bulkingest/nodes=12/rows=4000000000/elastic=false/create_index [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/21352073?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/21352073?buildTab=artifacts#/schemachange/bulkingest/nodes=12/rows=4000000000/elastic=false/create_index) on master @ [322d13b08e95f4c342cb6e8418cf439a943242f3](https://github.com/cockroachdb/cockroach/commits/322d13b08e95f4c342cb6e8418cf439a943242f3):

Failed with:

```
(schemachange.go:663).2: pq: running execution from '0001-01-01 00:00:00' to '2026-05-19 17:55:53.477573' on 1 failed: inbox communication error: grpc: context canceled [code 1/Canceled]
(monitor.go:267).Wait: monitor failure: context canceled
unexpected node event: n10: cockroach process for system interface died (exit code 7)
(metric_utils.go:208).CloseExporter: failed to export perf stats: context canceled
(test_runner.go:2051).maybeSaveClusterDueToInvariantProblems: invariant problem - snap name :
logs/cockroach.teamcity-21352073-1779175031-273-n12cpu4-0010.ubuntu.2026-05-19T17_23_34Z.003496.log:F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 local corruption detected: pebble: backing file 003338 error: pebble/table: invalid table 003338: (bad magic number: 0x?0000000000000000?)
logs/cockroach.log:F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 local corruption detected: pebble: backing file 003338 error: pebble/table: invalid table 003338: (bad magic number: 0x?0000000000000000?)
test artifacts and logs in: /artifacts/schemachange/bulkingest/nodes=12/rows=4000000000/elastic=false/create_index/run_1
```
Fatal entries found in Cockroach logs:

```
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 local corruption detected: pebble: backing file 003338 error: pebble/table: invalid table 003338: (bad magic number: 0x‹0000000000000000›)
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 +(1) ‹path: /mnt/data1/cockroach/003338.sst›
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 +Wraps: (2) attached stack trace
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + -- stack trace:
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | github.com/cockroachdb/pebble.NewFileCache.func1
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | external/com_github_cockroachdb_pebble/file_cache.go:499
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | github.com/cockroachdb/pebble/internal/genericcache.(*shard[...]).findOrCreateValue
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | external/com_github_cockroachdb_pebble/internal/genericcache/shard.go:235
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | github.com/cockroachdb/pebble/internal/genericcache.(*Cache[...]).FindOrCreate
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | external/com_github_cockroachdb_pebble/internal/genericcache/cache.go:96
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 local corruption detected: pebble: backing file 003338 error: pebble/table: invalid table 003338: (bad magic number: 0x‹0000000000000000›)
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 +(1) ‹path: /mnt/data1/cockroach/003338.sst›
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 +Wraps: (2) attached stack trace
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + -- stack trace:
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | github.com/cockroachdb/pebble.NewFileCache.func1
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | external/com_github_cockroachdb_pebble/file_cache.go:499
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | github.com/cockroachdb/pebble/internal/genericcache.(*shard[...]).findOrCreateValue
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | external/com_github_cockroachdb_pebble/internal/genericcache/shard.go:235
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | github.com/cockroachdb/pebble/internal/genericcache.(*Cache[...]).FindOrCreate
F260519 17:55:53.189597 121215 storage/pebble.go:1438 ⋮ [n10,s10,pebble] 304 + | external/com_github_cockroachdb_pebble/internal/genericcache/cache.go:96
```
Cluster Node to Ip Mapping:

| Node | Public IP | Private IP |
| --- | --- | --- |
| teamcity-21352073-1779175031-273-n12cpu4-0001 | 35.229.89.152 | 10.142.0.105 |
| teamcity-21352073-1779175031-273-n12cpu4-0002 | 34.138.76.216 | 10.142.0.208 |
| teamcity-21352073-1779175031-273-n12cpu4-0003 | 35.231.159.64 | 10.142.0.116 |
| teamcity-21352073-1779175031-273-n12cpu4-0004 | 35.185.71.172 | 10.142.0.154 |
| teamcity-21352073-1779175031-273-n12cpu4-0005 | 34.138.117.177 | 10.142.0.224 |
| teamcity-21352073-1779175031-273-n12cpu4-0006 | 34.26.222.10 | 10.142.0.210 |
| teamcity-21352073-1779175031-273-n12cpu4-0007 | 35.185.39.122 | 10.142.0.186 |
| teamcity-21352073-1779175031-273-n12cpu4-0008 | 34.23.95.192 | 10.142.0.129 |
| teamcity-21352073-1779175031-273-n12cpu4-0009 | 34.139.182.61 | 10.142.0.216 |
| teamcity-21352073-1779175031-273-n12cpu4-0010 | 34.23.143.192 | 10.142.0.109 |
| teamcity-21352073-1779175031-273-n12cpu4-0011 | 34.73.234.42 | 10.142.0.232 |
| teamcity-21352073-1779175031-273-n12cpu4-0012 | 34.74.141.184 | 10.142.1.21 |

Parameters:
- arch=amd64
- cloud=gce
- coverageBuild=false
- cpu=4
- diskCount=4
- encrypted=false
- fs=ext4
- localSSD=true
- runtimeAssertionsBuild=false
- saved=invariant problem - snap name <failed>
Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

See: [Grafana](https://go.crdb.dev/roachtest-grafana/teamcity-21352073/schemachange-bulkingest-nodes-12-rows-4000000000-elastic-false/1779211377876/1779213633297)

See: [Datadog Logs](https://us5.datadoghq.com/logs?query=service%3Aroachtest+%40cluster%3Ateamcity-21352073-1779175031-273-n12cpu4&from_ts=1779211377876&to_ts=1779213633297&live=false&storage=flex_tier)

/cc @cockroachdb/sql-foundations

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*schemachange/bulkingest/nodes=12/rows=4000000000/elastic=false/create_index.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-64083