cockroachdb / cockroachdb/cockroach-operator

Permission denied in minikube cockroachdb cluster

Open
#897 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
318
Forks
104
Avg merge
1d 6h
Merged PRs (30d)
1

Description

I followed [the official instructions for a local kubernetes cluster](https://www.cockroachlabs.com/docs/stable/orchestrate-a-local-cluster-with-kubernetes.html). It worked.

I then tried to use a persistent volume for the database data. The cockroachdb pods fail to start with the following error message:

```
++ expr 8192 / 4
++ expr 8192 / 4
+ exec /cockroach/cockroach.sh start --join=blahcockroachdb-0.blahcockroachdb.default:26258,blahcockroachdb-1.blahcockroachdb.default:26258,blahcockroachdb-2.blahcockroachdb.default:26258 --advertise-host=blahcockroachdb-1.blahcockroachdb.default --certs-dir=/cockroach/cockroach-certs/ --http-port=8080 --sql-addr=:26257 --listen-addr=:26258 '--log={sinks: {stderr: {channels: [OPS, HEALTH], redact: true}}}' --cache 2048MiB --max-sql-memory 2048MiB
unable to GC log files: open /cockroach/cockroach-data/logs: permission denied
```

I believe https://github.com/kubernetes/minikube/issues/1990 is causing the permission denied error because the mounted persistent volume is not writable by user 1000581000 despite [fsGroup being set to 1000581000 for the volume](https://github.com/cockroachdb/cockroach-operator/blob/c133bd007e0ee9e6a0bc25f408943c5200188b71/pkg/resource/statefulset.go#L208).

A workaround might be to modify the operator to `chown` or `chgrp` the `/cockroach/cockroach-data` directory appropriately.

https://github.com/cockroachdb/cockroach-operator/blob/c133bd007e0ee9e6a0bc25f408943c5200188b71/pkg/resource/statefulset.go#L46

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.