Rdatatable / Rdatatable/data.table
Make fread() automatically handle UTF-8 encoded files on Windows
Open
Nobody has claimed this yet.
encoding
fread
- Dominant language
- R
- Stars
- 3.9k
- Forks
- 1.1k
- Avg merge
- 14h 4m
- Merged PRs (30d)
- 4
Description
It would be nice, if fread() could automatically handle "UTF-8" encoded files correctly on Windows as the functions in readr package do.
Try the ezerai dataset in #2431
fread('ezerai', sep = '\t')
A few top rows:
readr::read_delim('ezerai', delim = '\t', locale = locale(decimal_mark = ","))
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the issue with fread('ezerai', sep='\t') on Windows and compare its output with readr::read_delim. The ezerai dataset and the fread() entry point are the only concrete references provided; done means UTF-8 encoded input is handled correctly without requiring manual encoding options.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- r
- Domain
- data
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100