AbsaOSS / AbsaOSS/cobrix

Add an option to automatically detect record type

Ouverte
#355 0 commentaires 0 réactions 1 personne assignée Réclamée par @yruslan Voir sur GitHub
enhancement
Langage dominant
Scala
Étoiles
170
Forks
96
Merge moyen
57 min
PR mergées (30 j)
2

Description

## Background
Determining record type is critical for reading mainframe files. Yet, most issues raised are related to the confusion of specifying the type of records in a mainframe file. Simplifying this bit would help getting started with Cobrix quicker.

## Feature
Add an option, say,
```
.option("infer_record_type", "true")
```
that would read the input file and determine:
1. Presence and type of RDW (big-endian or little-endian)
2. True record size for fixed record-length files

Cobrix should log options used for reading such files so that the automatic inference could be replaced by these explicit options for future jobs.

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.