AbsaOSS / AbsaOSS/enceladus

Add support for Datasets of Streaming type

未关闭
#1,633 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
feature Menas priority: undecided Streaming under discussion UX
主要语言
Scala
星标
33
派生
16
PR 合并指标
30 天内没有已合并 PR

描述

## Background
Currently, Datasets require users to have HDFS paths specified. Streaming users do not have these. They only leverage Menas for Conformance Engine.

## Feature
Allow users to not have HDFS paths if they are conformance users

## Proposed Solution [Optional]
Solution Ideas
1. New Dataset sub-type
2. New Dataset property, switch for each of the types (2 for now)
3. Just put a checkbox "streaming" into the creation/editing of the dataset that disables validation and saves paths as `N/A`

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。