h2oai / h2oai/datatable

fread erroneously guesses sep=' '

Open
#518 8 comments 0 reactions 0 assignees View on GitHub
bug fread improve low priority
Dominant language
C++
Stars
1.9k
Forks
164
Avg merge
7h 31m
Merged PRs (30d)
1

Description

https://archive.ics.uci.edu/ml/machine-learning-databases/badges/badges.data

Seems like reasonable data set that needs better white space detection -- similar to datetime, here is firstnameinitiallastname and dt gets confused when name format changes slightly. As you said, if human can parse very readily, should be possible for dt to parse too with a few extra rules.

tmp/seeds/72552/test_random_1508903108.2884815.stderr:RuntimeError: Line 2 from sampling jump 0 starting "+ David W." has more than the expected 3 fields. Separator 3 occurs at position 11 which is character 3 of the last field: "W. Aha". Consider setting 'comment.char=' if there is a trailing comment to be ignored.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.