AbsaOSS / AbsaOSS/cobrix

Add ability to load wider range of EOL separated text files

Open
#297 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
170
Forks
96
Avg merge
57m
Merged PRs (30d)
2

Description

## Background
Currently, `.option("is_text", "true")` is limited to ASCII UTF-8 files.
EOL separators allow us to treat a file as a fully variable-length file.

## Feature
Implement `is_text` through variable-length readers to
- [ ] Allow other charsets for ASCII
- [ ] Allow specifying EOL character and escape
- [ ] Allow EBCDIC with code pages
- [ ] Allow multisegment and hierarchical records

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.