AbsaOSS / AbsaOSS/cobrix

Does Cobrix handle the Easytrieve layout ?

未關閉
#623 3 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
question
主要語言
Scala
星號
170
分支
96
平均合併
57 分鐘
30 天內合併 PR
2

描述

# Background

I am having the Easytrive layout which is having the Packed unsigned fields (data-type U in Easytrieve), binary unsigned fields (data-type B in Easytrieve) and Alpha-numeric fields (data-type A in Easytrieve and storing Hexbit). The Data file that we are trying to convert is EBCDIC data

# Question

We were using cobrix for couple of files which it worked fine till now. Recently encountered one new file of Easytrieve layout which is not cobol
and we are not able to decode the file into ascii.

We are using below options/parameters to read the file.

> def read_dataframe(spark, copybook):
>     return (
>         spark.read.format("cobol")
>         .option("record_format","F")
>         .option("encoding", "ebcdic")
>         .option("copybook", copybook) #Copybook
>         .option("enable_indexes", "false")
>         .option("input_split_size_mb", "256")
>         .option("drop_value_fillers", "true")
>         .option("drop_group_fillers", "false")
>         .option("generate_record_id", "false")
>         .option("schema_retention_policy", "keep_original")
>         .option("paths", ",".join(data_files)) #EBCIDIC File
>         .load()
>     )

Please find the attached sample data and layout for your reference @yruslan .

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。