apache / apache/kyuubi

[FEATURE] Can kyuubi supports standealone hive config for Flink?

Open
#2,408 4 comments 0 reactions 0 assignees View on GitHub
kind:feature priority:major
Dominant language
Scala
Stars
2.4k
Forks
1k
PR merge metrics
No merged PRs in 30d

Description

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

### Search before asking

- [X] I have searched in the [issues](https://github.com/apache/incubator-kyuubi/issues?q=is%3Aissue) and found no similar issues.

### Describe the feature

Flink now use the default in-memory catalog as the hive metastore. Can we support standealone hive config like flink.hive.metastore.uris in the $KYUUBI_HOME/conf/kyuubi-defaults.conf, which allows Flink points to a remote hive server when the engine starts

### Motivation

Flink user wants to use remote hive metastore in Kyuubi

### Describe the solution

add config option(etc.flink.hive.metastore.uris ) in kyuubi-defaults.conf

### Additional context

_No response_

### Are you willing to submit PR?

- [X] Yes I am willing to submit a PR!

Contributor guide

Open the contributing guide

Research direction

Start by examining how Flink engine settings from $KYUUBI_HOME/conf/kyuubi-defaults.conf are read and passed during engine startup. Trace the existing configuration path for related engine options, then verify that a configured flink.hive.metastore.uris value reaches Flink and enables a remote Hive metastore when the engine starts.

Written by the indexing model from the issue text.

Assessment

Tech stack
hadoop
Domain
databases, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.