apache / apache/pulsar

[Bug] Printing of secrets to console when creating a delta lake sink

Open
#24,142 0 comments 0 reactions 0 assignees View on GitHub
type/bug
Dominant language
Java
Stars
15.3k
Forks
3.8k
Avg merge
1d 14h
Merged PRs (30d)
160

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar.

### Read release policy

- [x] I understand that unsupported versions don't get bug fixes. I will attempt to reproduce the issue on a supported version of Pulsar client and Pulsar broker.

### Version

Ran on the apachepulsar/pulsar:3.0.10 docker.

- OS: Ubuntu 22.04.5
- Java: 17.0.14
- Pulsar version: 3.0.10
- Deployment: standalone and cluster
- Connector: pulsar-io-lakehouse-3.0.7.5-cloud.nar

### Minimal reproduce step

0. Startup any pulsar cluster
1. configure a sink (for example delta lake sink) with a SimpleAWSCredentialProvider
2. create the sink
3. output shows the entire config: including secrets

### What did you expect to see?

Either to not have the secrets being printed to the console/stdout or have it anonymised with ******
Or, an way to pass environment variables to the kubernetes runtime in the sink create statement (via sink-config), so the EnvironmentCredentialProvider can be used for kubernetes runtimes.

### What did you see instead?

The entire config of the sink with secrets printed to the console: quite undesirable.

### Anything else?

It would be ideal to have a way of setting environment variables in the kubernetes runtime (not secrets, but just simple env vars). Being able to pass these via the config.

### Are you willing to submit a PR?

- [x] I'm willing to submit a PR!

Contributor guide

Open the contributing guide

Research direction

Start by reproducing sink creation with the listed Pulsar 3.0.10 Docker image, delta lake sink, and SimpleAWSCredentialProvider, then trace the sink-create path that prints the configuration to stdout. Done means credentials are absent or masked in console output, with the chosen behavior covered by an appropriate test.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, java, kubernetes
Domain
cloud, security
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.