AbsaOSS / AbsaOSS/cobrix

Does Cobrix handle the Easytrieve layout ?

Abierto
#623 3 comentarios 0 reacciones 0 asignados Ver en GitHub
question
Lenguaje dominante
Scala
Estrellas
170
Forks
96
Merge medio
57 min
PR fusionados (30 d)
2

Descripción

# Background

I am having the Easytrive layout which is having the Packed unsigned fields (data-type U in Easytrieve), binary unsigned fields (data-type B in Easytrieve) and Alpha-numeric fields (data-type A in Easytrieve and storing Hexbit). The Data file that we are trying to convert is EBCDIC data

# Question

We were using cobrix for couple of files which it worked fine till now. Recently encountered one new file of Easytrieve layout which is not cobol
and we are not able to decode the file into ascii.

We are using below options/parameters to read the file.

> def read_dataframe(spark, copybook):
>     return (
>         spark.read.format("cobol")
>         .option("record_format","F")
>         .option("encoding", "ebcdic")
>         .option("copybook", copybook) #Copybook
>         .option("enable_indexes", "false")
>         .option("input_split_size_mb", "256")
>         .option("drop_value_fillers", "true")
>         .option("drop_group_fillers", "false")
>         .option("generate_record_id", "false")
>         .option("schema_retention_policy", "keep_original")
>         .option("paths", ",".join(data_files)) #EBCIDIC File
>         .load()
>     )

Please find the attached sample data and layout for your reference @yruslan .

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.