AbsaOSS / AbsaOSS/enceladus

Further partitioning of Publish data based on other fields in the Dataset

未关闭
#1,704 0 条评论 1 个 reaction 已指派 0 人 在 GitHub 查看
Epic priority: undecided under discussion
主要语言
Scala
星标
33
派生
16
PR 合并指标
30 天内没有已合并 PR

描述

## Background
It might be useful to further partition the data after the conformance phase, based on the fields of the dataset. Done per user setup.

## Goal
Enable sub-partitoning of data at the end of the Conformance phase based on dataset configuration

## Expected Task List
A list of expected issues that will be needed to achieve this Epic
1. New optional set-up for dataset specifying the sub-partioning based on the dataset fields
2. The actual partitioning in _SparkJobs_
3. According UI changes to allow the set up.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。