Read UTF-16 CSV and Text files
Open
core
P3
python
wish
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
At this moment it is not possible for Apache Beam Python version 2.7 to read UTF-16 text files or csv files. I would like to have the possibility to read this kind of unicode. Currently the issue that UTF-16 cannot be read is described in:
[https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/textio.py](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/textio.py)
If somebody has an idea to fix it I would be more than happy to assist.
Imported from Jira [BEAM-5856](https://issues.apache.org/jira/browse/BEAM-5856). Original Jira may contain additional context.
Reported by: paulv.
Contributor guide
Assessment
This issue has not been assessed yet.