Regex parser should have the option to 'skip' some number of header rows like the CSV parser can
Open
Area - Batch Ingestion
Area - Web Console
Feature/Change Description
Starter
- Dominant language
- Java
- Stars
- 14.1k
- Forks
- 3.8k
- Avg merge
- 2d 58m
- Merged PRs (30d)
- 233
Description
This would be super useful for ingesting data that has some form of a header such as what is seen in https://github.com/apache/incubator-druid/issues/8555.
Contributor guide
Research direction
Start by comparing the regex parser's ingestion path with the existing CSV parser support for skipping header rows. Define the desired option and verify that regex ingestion skips the requested number of rows while preserving the remaining records; the issue names no files or tests, so repository exploration is required.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100