AbsaOSS / AbsaOSS/cobrix

Variable length record parsing

Open
#604 2 comments 0 reactions 0 assignees View on GitHub
question
Dominant language
Scala
Stars
170
Forks
96
Avg merge
57m
Merged PRs (30d)
2

Description

## Background [Optional]
I have multi layout file with certain order.
I group each layout and last layout is repeated multiple times.

each layout is fixed length file(200 bytes).

Example:
1.FH
2.LH
3.BH1
4.DE1
5.AD
:
:
10.DE2
11.AD
:
13.BH2
14.DE1
15.AD
:
:

I rearrange layouts like
FH,LH,BH1,DE1,{4 bytes count of AD}Array[AD]
FH,LH,BH1,DE2,{4 bytes count of AD}Array[AD]
FH,LH,BH2,DE1,{4 bytes count of AD}Array[AD]
FH,LH,BH2,DE2,{4 bytes count of AD}Array[AD]

## Question

How do I parse RDD[Array[Bytes]] using framework?

‘’’
import za.co.absa.cobrix.spark.cobol.Cobrix

val rdd = ???
val df = Cobrix.fromRdd
.copybookContents(copybook)
.option("encoding", "ebcdic") // any supported option
.load(rdd)

‘’’

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.