mafintosh / mafintosh/csv-parser
csv-parser does not parse big csv file correct, after ~95K rows it begins merge all rows in single JSON.
Open
Nobody has claimed this yet.
- Dominant language
- JavaScript
- Stars
- 1.5k
- Forks
- 143
- PR merge metrics
- No merged PRs in 30d
Description
* Operating System:
Centos 7
* Node Version:
[16.13.0]([url](url))
* NPM Version:
* 8.1.4
* csv-parser Version:
v3.0.0
### Expected Behavior
167K rows parsed
### Actual Behavior
95 K rows parsed
### How Do We Reproduce?
https://edbq.xyz/test/Freight3.csv
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the issue with the linked Freight3.csv file using csv-parser v3.0.0 on Node 16.13.0, and compare the parsed output around 95K rows with the expected 167K rows. Trace where rows begin merging into one JSON value; done means the full file produces 167K correctly separated rows.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript, node.js
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100