elastic / elastic/logstash

Make it easier to ingest CSV files

Open
#2,088 40 comments 12 reactions 0 assignees View on GitHub
enhancement
Dominant language
Java
Stars
14.9k
Forks
3.5k
Avg merge
19h 14m
Merged PRs (30d)
63

Description

CSV files are fairly common and almost always include a header line with name of fields.
Right now logstash requires to:
- somehow skip the header, by doing a messy match + drop
- specify manually the columns to understand the rest of files.

It would be really awesome if LS would just grab the field names from 1st line and then discard it, maybe controlled by a 'header-line' option.
I understand that it may not be easy to do if filters have no control over the input, and also when resuming a load it would have to read the header line 1st.
But it could be pretty powerful if the input could be controlled by the filter, or just add more input options, to generally handle the concept of header and feed it to the filter.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.