AbsaOSS / AbsaOSS/enceladus

Add options to control caching in Spark Jobs

未关闭
#923 1 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
Conformance feature priority: undecided Standardization under discussion
主要语言
Scala
星标
33
派生
16
PR 合并指标
30 天内没有已合并 PR

描述

## Background
Currently, Standardization and Conformance uses the default caching strategy (provided by `df.cache()`). For some jobs (very big files), different cache modes may be preferrable, including turning off cache altogether.

## Feature
Add an option to Standardization and Conformance to control cache strategy. One of the strategies should be no caching at all.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。