cockroachdb / cockroachdb/cockroach
import: v23.2.4 import always returns error at 10 minute mark
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
**Describe the problem**
CRDB v23.2.4 returns an error after 10 minutes
**To Reproduce**
```
# Create a 3x4 CRDB cluster and a 1x4 workload cluster.
roachprod create $EMAIL-test -n 3 --gce-machine-type=n2-standard-4 --local-ssd=false --geo --gce-zones='us-east1-b,us-east1-c,us-east1-d'
roachprod create $EMAIL-test-load -n 1 --gce-machine-type=n2-standard-4 --local-ssd=false --geo --gce-zones='us-east1-b'
# Clear any transient roachprod errors
roachprod sync
roachprod setup-ssh $EMAIL-test
roachprod setup-ssh $EMAIL-test-load
# Start CRDB.
roachprod stage $EMAIL-test release v23.2.4
roachprod start $EMAIL-test --secure --sql-port 29001
# Copy certs to workload cluster.
roachprod get $EMAIL-test:1 certs ./remote-certs
roachprod put $EMAIL-test-load ./remote-certs certs
roachprod run $EMAIL-test-load -- 'sudo chmod 600 certs/*'
roachprod run $EMAIL-test-load -- 'echo "postgresql://root@localhost:26257?sslcert=./certs/client.root.crt&sslkey=./certs/client.root.key&sslmode=verify-full&sslrootcert=./certs/ca.crt" > sql-url.txt'
rm -rf ./remote-certs
# Install workload tool and haproxy in workload cluster.
roachprod stage $EMAIL-test-load workload
roachprod stage $EMAIL-test-load cockroach
export crdb_ip=$(roachprod ip $EMAIL-test:1 --external)
roachprod run $EMAIL-test-load -- "./cockroach gen haproxy --certs-dir=./certs --host=$crdb_ip:29001"
roachprod run $EMAIL-test-load -- 'sudo apt-get install -y haproxy'
roachprod run $EMAIL-test-load -- 'haproxy -f haproxy.cfg > haproxy.log 2>&1 < /dev/null &'
# Run TPC-H import that takes longer than 10 minutes.
roachprod run $EMAIL-test-load -- './workload init tpch --scale-factor=10 --data-loader=IMPORT "$(cat sql-url.txt)"'
```
EXPECTED: Import should complete successfully.
ACTUAL: Import always fails 10 minutes after starting with this error:
```
Error: importing fixture: importing table lineitem: pq: relation "lineitem" is offline: importing
Error: COMMAND_PROBLEM: exit status 1
(1) Node 1. Command with error:
| ```
| ./workload init tpch --scale-factor=10 --data-loader=IMPORT "$(cat sql-url.txt)"
| ```
Wraps: (2) COMMAND_PROBLEM
Wraps: (3) exit status 1
Error types: (1) *hintdetail.withDetail (2) errors.Cmd (3) *exec.ExitError
```
Jira issue: CRDB-38435
Epic CRDB-62881
Contributor guide
Assessment
This issue has not been assessed yet.