AbsaOSS / AbsaOSS/cobrix

multi copybook or not

Open
#140 8 comments 0 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
170
Forks
96
Avg merge
57m
Merged PRs (30d)
2

Description

I have a copybook which has multiple 01 levels. Can this copy book is parsed as variable length.
can I parse like below

cobolDataframe = spark
.read
.format("cobol")
.option("copybook", v_copybook)
.option("schema_retention_policy", "collapse_root") //removes the root record headerc
.option("drop_group_fillers", "false")
.option("generate_record_id", false) // this adds the file id and record id
.option("is_record_sequence", "true") // reader to use 4 byte record headers to extract records from a mainframe file
.option("is_rdw_big_endian", "true")
//.option("is_rdw_part_of_record_length", false)
.option("rdw_adjustment", -4)
.load(v_data)

Please confirm.
After parsing I am not getting correct parsed data.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.