Add facets to OpenLineage
Open
Feature/Change Description
- Dominant language
- Java
- Stars
- 14.1k
- Forks
- 3.8k
- Avg merge
- 2d 58m
- Merged PRs (30d)
- 233
Description
### Description
The OpenLineage emitter currently emits empty dataset facets ("facets": {}). Follow up to add:
- schema facet: column names and types from Druid segment metadata
- columnLineage facet: mapping output columns to input columns
See PR #19107
Contributor guide
Research direction
Start by tracing the OpenLineage emitter and the Druid segment metadata path, then read PR #19107 for context. Done means dataset facets are no longer empty: the schema facet contains column names and types from segment metadata, and the columnLineage facet maps output columns to input columns.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100