AbsaOSS / AbsaOSS/spline-spark-agent
Removing unnecessary parameters from JDBC URIs
Open
- Dominant language
- Scala
- Stars
- 210
- Forks
- 102
- Avg merge
- 1d 1h
- Merged PRs (30d)
- 1
Description
When spark is reading/writing with JDBC datasource spline reports its URI to lineage - that's greate because database and table are visible there
Unfortunately some non-datasource-identifing parameters are also added in that URI, for example:
`jdbc:mysql://host:3336/my_database?serverTimezone=Poland&useSSL=false&characterEncoding=utf8:my_table`
Not sure if there's generic way to remove such `serverTimezone`, `useSSL`, `characterEncoding` parameters ? They may cause lineage problems if other job uses same datasource but with different URI parameters
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.