51zero / 51zero/eel-sdk

Orc properties for Hive Source and Sink

未关闭
#247 2 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
enhancement help wanted
主要语言
Scala
星标
147
派生
32
PR 合并指标
30 天内没有已合并 PR

描述

I just want to confirm that we respect the following Hive properties outlined in the documentation:

- Hive: http://orc.apache.org/docs/hive-config.html

My only concern is that our Orc dialect for Hive Source and Sink delegates to the same code base for our native Orc Source and Sink and hence ignoring these table properties?

If this is the case we should automatically pick up these options from the Hive Metastore when using HiveSource and HiveSink, and support them natively when using the OrcSink and OrcSource?

贡献指南

这个仓库没有索引到贡献指南

调研方向

Check the HiveSource and HiveSink implementations to see if they delegate to OrcSource and OrcSource. Review the ORC dialect code to verify if Hive table properties from the metastore are being read and applied. Look for configuration handling in the ORC module and compare with the Hive config documentation. Determine what changes are needed to respect these properties in both Hive and native ORC contexts.

由索引模型根据 Issue 内容生成。

评估

技术栈
hadoop, scala
领域
data-engineering, databases
Issue 类型
缺陷
难度
4/5
预计耗时
3-5 天
活跃度
停滞
描述清晰度
基本清楚
新手友好度
35/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。