apache / apache/druid

Regex parser should have the option to 'skip' some number of header rows like the CSV parser can

Open
#8,583 6 comments 0 reactions 0 assignees View on GitHub
Area - Batch Ingestion Area - Web Console Feature/Change Description Starter
Dominant language
Java
Stars
14.1k
Forks
3.8k
Avg merge
2d 58m
Merged PRs (30d)
233

Description

This would be super useful for ingesting data that has some form of a header such as what is seen in https://github.com/apache/incubator-druid/issues/8555.

Contributor guide

Open the contributing guide

Research direction

Start by comparing the regex parser's ingestion path with the existing CSV parser support for skipping header rows. Define the desired option and verify that regex ingestion skips the requested number of rows while preserving the remaining records; the issue names no files or tests, so repository exploration is required.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.