AbsaOSS / AbsaOSS/enceladus

Further partitioning of Publish data based on other fields in the Dataset

Ouverte
#1,704 0 commentaires 1 réaction 0 personnes assignées Voir sur GitHub
Epic priority: undecided under discussion
Langage dominant
Scala
Étoiles
33
Forks
16
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

## Background
It might be useful to further partition the data after the conformance phase, based on the fields of the dataset. Done per user setup.

## Goal
Enable sub-partitoning of data at the end of the Conformance phase based on dataset configuration

## Expected Task List
A list of expected issues that will be needed to achieve this Epic
1. New optional set-up for dataset specifying the sub-partioning based on the dataset fields
2. The actual partitioning in _SparkJobs_
3. According UI changes to allow the set up.

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.