stackabletech / stackabletech/hdfs-operator
Missing properties in discovery core-site.xml for Hive impersonation
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 53
- Forks
- 9
- Avg merge
- 1d 13h
- Merged PRs (30d)
- 10
Description
Description
When using kerberized HDFS and Hive, for impersonation some properties must be set which are currently e.g. overriden in HDFS as in this Hive test
https://github.com/stackabletech/hive-operator/blob/235a531bf463e91a59578f5edd4602afba8cf8ba/tests/templates/kuttl/kerberos-hdfs/30-install-hdfs.yaml.j2#L32
hadoop.proxyuser.hive.hosts="*"
hadoop.proxyuser.hive.users="*"
This works for HDFS and the role / rolegroup level, but is left out from the "discovery" core-site.xml.
This leads to problems for Hive impersonation which just mounts the core-site.xml.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Inspect the code that generates the discovery core-site.xml and compare it with the properties set in tests/templates/kuttl/kerberos-hdfs/30-install-hdfs.yaml.j2. Start by tracing how role and rolegroup configuration differs from discovery configuration. Done means the Hive proxy-user properties are present in the discovery file and can support Hive impersonation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- hadoop, kubernetes, rust
- Domain
- devops, distributed-systems
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100