AbsaOSS / AbsaOSS/cobrix

Getting BDW header error convert Ebcdic file to ascii

Offen
#589 6 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
Vorherrschende Sprache
Scala
Sterne
170
Forks
96
Ø Merge
57 Min.
Gemergte PRs (30 T.)
2

Beschreibung

I have a use-case where i have a variable block Cobol file and need to parse the file in ASCII format using the Cobrix dependencies. I am using below Cobrix dependency jar file.
spark-cobol_2.12-2.6.3.jar
cobol-parse_2.12-2.6.3.jar
scodec-core_2.12-1.10.3.jar
scodec-bite_2.12-1.1.4.jar
antlr-runtime-4.8.ar

But i am getting error- BDW headers contain non-zero values where zeros are expected(check rdw_big_endian flag. Header:125,149,0,0, offset:0..

Even i have tried other option like - rdw_adjustment -4 , is_bdw_big_endian is true and is_rdw_big_endian is true but getting same header error.

So how header is generated in the ebcdic file and what could be the solution of this issue

Below is my data frame to read the file

val df = spark
.read
.format("cobol")
.option("copybook_contents", copybook)
.option("record_format", "VB")
.option("copybook", "copybook")
.option("is_bdw_big_endian", "false")
.option("is_rdw_big_endian", "false")
.option("schema_retention_policy", "collapse_root")
.load("data")

Beitragsleitfaden

Für dieses Repository ist kein Beitragsleitfaden indexiert

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.