AbsaOSS / AbsaOSS/enceladus

Multiple outputs from Mapping Table

Ouverte
#1,648 3 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Conformance Epic feature Menas priority: medium Streaming UX
Langage dominant
Scala
Étoiles
33
Forks
16
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

## Background
Sometimes you might need 2 columns from the mapping table in your dataset.

## Feature
Allow Mapping Table CR to have an output of more than one column

## Example [Optional]
Mapping on ClientID column, wanting to take away name and surname from the MappingTable.

## Proposed Solution [Optional]
```scala
case class MappingConformanceRule(
order: Int,
controlCheckpoint: Boolean,
mappingTable: String,
mappingTableVersion: Int,
attributeMappings: Map[String, String], //key = mapping table column, value = input df column
targetAttribute: Array[String], // <----
outputColumn: Array[String], // <----
isNullSafe: Boolean = false) extends ConformanceRule
```

## Question
Would other rules benefit from this?

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.