make CSV ingest plugin smarter about selecting variable names
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 1.1k
- Forks
- 564
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 29
Description
If you upload bronze.csv and use the debug exporter to examine the datasetFileDetails object, you'll see that the first variable, time, has a byte order mark (U+FEFF) preprended to the front of both name and label.
Here's how it looks in vi:
This is causing validation errors at https://huggingface.co/spaces/JoaquinVanschoren/croissant-checker because our Croissant exporter uses the datasetFileDetails data.
This issue was split off from this one:
- #11462
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start at the CSV ingest plugin and reproduce the issue by uploading bronze.csv, then inspect the datasetFileDetails object with the debug exporter. Trace how the first variable's name and label are selected, and verify that the resulting values no longer begin with the U+FEFF byte order mark.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- backend, data
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100