AbsaOSS / AbsaOSS/enceladus

Multiple outputs from Mapping Table

Open
#1,648 3 comments 0 reactions 0 assignees View on GitHub
Conformance Epic feature Menas priority: medium Streaming UX
Dominant language
Scala
Stars
33
Forks
16
PR merge metrics
No merged PRs in 30d

Description

## Background
Sometimes you might need 2 columns from the mapping table in your dataset.

## Feature
Allow Mapping Table CR to have an output of more than one column

## Example [Optional]
Mapping on ClientID column, wanting to take away name and surname from the MappingTable.

## Proposed Solution [Optional]
```scala
case class MappingConformanceRule(
order: Int,
controlCheckpoint: Boolean,
mappingTable: String,
mappingTableVersion: Int,
attributeMappings: Map[String, String], //key = mapping table column, value = input df column
targetAttribute: Array[String], // <----
outputColumn: Array[String], // <----
isNullSafe: Boolean = false) extends ConformanceRule
```

## Question
Would other rules benefit from this?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.