apache / apache/kyuubi

RangerSparkExtension - ConfigMaps not deleted on Kubernetes

Open
#5,237 2 comments 0 reactions 0 assignees View on GitHub
kind:bug priority:major
Dominant language
Scala
Stars
2.4k
Forks
1k
PR merge metrics
No merged PRs in 30d

Description

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

### Search before asking

- [X] I have searched in the [issues](https://github.com/apache/kyuubi/issues?q=is%3Aissue) and found no similar issues.

### Describe the bug

On Kubernetes, after each query, even if all the pods are deleted successfully, a ConfigMap still remains without related resources. The ConfigMap is named:
```
spark-exec-...-conf-map
```
and contains the following configuration files:
```
ranger-spark-audit.xml
ranger-spark-security.xml
```

### Affects Version(s)

1.7.1

### Kyuubi Server Log Output

```logtalk
Not applicable
```

### Kyuubi Engine Log Output

```logtalk
Not applicable
```

### Kyuubi Server Configurations

```yaml
kyuubi.authentication=KERBEROS
kyuubi.frontend.connection.url.use.hostname=false
kyuubi.frontend.protocols=THRIFT_BINARY
kyuubi.ha.addresses=xxx
kyuubi.ha.namespace=kyuubi
kyuubi.kinit.principal=xxx
kyuubi.kinit.keytab=xxx
kyuubi.kubernetes.authenticate.caCertFile=xxx
kyuubi.kubernetes.authenticate.oauthTokenFile=xxx
kyuubi.kubernetes.namespace=xxx
kyuubi.metadata.store.jdbc.database.schema.init=false
kyuubi.metrics.enabled=true
spark.master=xxx
spark.driver.memory=xxx
spark.executor.memory=xxx
spark.dynamicAllocation.enabled=true
spark.dynamicAllocation.initialExecutors=1
spark.dynamicAllocation.maxExecutors=xxx
spark.dynamicAllocation.shuffleTracking.enabled=true
spark.sql.adaptive.enabled=true
spark.kubernetes.container.image=xxx
spark.kubernetes.container.image.pullPolicy=xxx
spark.kubernetes.driver.annotation.app.kubernetes.io/component=kyuubi
spark.kubernetes.driver.request.cores=xxx
spark.kubernetes.driver.limit.cores=xxx
spark.kubernetes.driverEnv.HADOOP_CONF_DIR=/opt/kyuubi/conf
spark.kubernetes.executor.annotation.app.kubernetes.io/component=kyuubi
spark.kubernetes.executor.request.cores=xxx
spark.kubernetes.executor.limit.cores=xxx
spark.kubernetes.executor.secrets.kyuubi-configs=/opt/kyuubi/conf
spark.executorEnv.HADOOP_CONF_DIR=/opt/kyuubi/conf
spark.kubernetes.namespace=xxx
spark.kerberos.access.hadoopFileSystems=xxx
spark.jars=/opt/ranger-plugin/libext/*.jar
spark.sql.extensions=org.apache.kyuubi.plugin.spark.authz.ranger.RangerSparkExtension
```

### Kyuubi Engine Configurations

```yaml
Not applicable
```

### Additional context

_No response_

### Are you willing to submit PR?

- [ ] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to fix.
- [ ] No. I cannot submit a PR at this time.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.