Allow storing the metastore configuration on Hadoop (HDFS, S3, etc)
未关闭
enhancement
Pramen-Scala
- 主要语言
- Scala
- 星标
- 31
- 派生
- 4
- 平均合并
- 1 天 10 分钟
- 30 天内合并 PR
- 4
描述
## Background
Currently, metastore config is a part of the configuration that is passed to Pramen on 'spark-submit'.
Sometimes it is very helpful to store parts of the configuration in a central location, like Hadoop
## Feature
Add an ability to store metastore or some other parts of configuration in Hadoop.
When Pramen starts it can start the Spark session based on the local configuration, and then load configuration from Hadoop (could be multiple files), and then load it alltogether.
贡献指南
这个仓库没有索引到贡献指南
评估
这个 Issue 还没有评估数据。