AbsaOSS / AbsaOSS/enceladus

Multiple outputs from Mapping Table

未关闭
#1,648 3 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
Conformance Epic feature Menas priority: medium Streaming UX
主要语言
Scala
星标
33
派生
16
PR 合并指标
30 天内没有已合并 PR

描述

## Background
Sometimes you might need 2 columns from the mapping table in your dataset.

## Feature
Allow Mapping Table CR to have an output of more than one column

## Example [Optional]
Mapping on ClientID column, wanting to take away name and surname from the MappingTable.

## Proposed Solution [Optional]
```scala
case class MappingConformanceRule(
order: Int,
controlCheckpoint: Boolean,
mappingTable: String,
mappingTableVersion: Int,
attributeMappings: Map[String, String], //key = mapping table column, value = input df column
targetAttribute: Array[String], // <----
outputColumn: Array[String], // <----
isNullSafe: Boolean = false) extends ConformanceRule
```

## Question
Would other rules benefit from this?

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。