AbsaOSS / AbsaOSS/spline-spark-agent
Spline support for expand operation
- Dominant language
- Scala
- Stars
- 210
- Forks
- 102
- Avg merge
- 1d 1h
- Merged PRs (30d)
- 1
Description
## Background
The Spline agent does not support column-level lineage tracking in expand operations. So, if my sql contains "grouping", or "with cube", the column lineage will be lost after expand.
## Feature
Add OperationNodeBuilder to deal with spark expand operation.
## Example [Optional]

## Proposed Solution [Optional]
Solution Ideas
1. I add a ExpandNodeBuilder class in package za.co.absa.spline.harvester.builder.plan, which has almost the same code as UnionNodeBuilder
2. I modified the class OperationNodeBuilderFactory, to deal with expand operators.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.