AbsaOSS / AbsaOSS/cobrix

Add an option to automatically detect record type

未关闭
#355 0 条评论 0 个 reaction 已指派 1 人 已被 @yruslan 认领 在 GitHub 查看
enhancement
主要语言
Scala
星标
170
派生
96
平均合并
57 分钟
30 天内合并 PR
2

描述

## Background
Determining record type is critical for reading mainframe files. Yet, most issues raised are related to the confusion of specifying the type of records in a mainframe file. Simplifying this bit would help getting started with Cobrix quicker.

## Feature
Add an option, say,
```
.option("infer_record_type", "true")
```
that would read the input file and determine:
1. Presence and type of RDW (big-endian or little-endian)
2. True record size for fixed record-length files

Cobrix should log options used for reading such files so that the automatic inference could be replaced by these explicit options for future jobs.

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。