CSV sniffing detects wrong field delimiter
Nobody has claimed this yet.
Assessment
This issue has not been assessed yet.
Description
Bug report
csv.Sniffer().sniff() detects the wrong field delimiter if the possible valid delimiters contain \t and the provided data contains one line starting with the combination of double quotes followed by a tab and has the same combination of double quotes and a tab at least once more afterwards in the data. In that case the delimiter is always reported as \t instead of the correct one.
Configuring the preferred separator as suggested in https://github.com/python/cpython/issues/80678#issuecomment-1093819685 doesn't have any effect on this behavior.
Here is an example to reproduce it:
import csv
from pprint import pprint
data = """
Surname;First Name;Year of birth
"\tDoe;Jane"\t;1971
"""
sniffer = csv.Sniffer()
dialect = sniffer.sniff(data, delimiters=",;\t")
pprint(dict(dialect.__dict__))
Expected output:
{'__doc__': None,
'__module__': 'csv',
'_name': 'sniffed',
'delimiter': ';',
'doublequote': False,
'lineterminator': '\r\n',
'quotechar': '"',
'quoting': 0,
'skipinitialspace': False}
Actual output:
{'__doc__': None,
'__module__': 'csv',
'_name': 'sniffed',
'delimiter': '\t',
'doublequote': False,
'lineterminator': '\r\n',
'quotechar': '"',
'quoting': 0,
'skipinitialspace': False}
Your environment
- CPython versions tested on: 3.7.14, 3.8.14, 3.9.14, 3.10.7
- Operating system and architecture: Debian/sid on amd64
- Dominant language
- Python
- Stars
- 77.2k
- Forks
- 36k
- Avg merge
- 1d 9h
- Merged PRs (30d)
- 558
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from python/cpython
-
docs pending
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
stdlib type-feature
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
stdlib type-feature
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
build type-bug
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
-
stdlib topic-email type-feature
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
-
🐛 Bug 🔔 Pending processing
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
jumpserver/jumpserver#17584 ·