Support for stream processing variable length records
Open
question
- Dominant language
- Scala
- Stars
- 170
- Forks
- 96
- Avg merge
- 57m
- Merged PRs (30d)
- 2
Description
@yruslan
I have large set of input files for processing. I wanted to take the stream processing approach. But, when i tried with the same options that i have successfully used for variable length records, like,
`
.option("generate_record_id", true)
.option("is_record_sequence", "true")
.option("is_rdw_big_endian", "true")
.option("variable_size_occurs", "true")
`
It was getting processed as FixedLength records.
Any thoughts or suggestions?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.