AbsaOSS / AbsaOSS/spline-spark-agent
Attribute dependency not captured for complex plans
Open
- Dominant language
- Scala
- Stars
- 210
- Forks
- 102
- Avg merge
- 1d 1h
- Merged PRs (30d)
- 1
Description
We observed that when there are multiple nested queries along with window functions involved, attribute dependency not properly tracked. For example, avg_monthly_purhcase dependency should point to customer_id and purchase_amount but the link is completely broken. Attaching test queries and generated plan..
[SampleQueryWithNestedWindowFunction.txt](https://github.com/AbsaOSS/spline-spark-agent/files/11364254/SampleQueryWithNestedWindowFunction.txt)
[customerprocess_plan.txt](https://github.com/AbsaOSS/spline-spark-agent/files/11364255/customerprocess_plan.txt)
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.