AbsaOSS / AbsaOSS/spline-spark-agent
Removing unnecessary parameters from JDBC URIs
- Vorherrschende Sprache
- Scala
- Sterne
- 210
- Forks
- 102
- Ø Merge
- 1 T. 1 Std.
- Gemergte PRs (30 T.)
- 1
Beschreibung
When spark is reading/writing with JDBC datasource spline reports its URI to lineage - that's greate because database and table are visible there
Unfortunately some non-datasource-identifing parameters are also added in that URI, for example:
`jdbc:mysql://host:3336/my_database?serverTimezone=Poland&useSSL=false&characterEncoding=utf8:my_table`
Not sure if there's generic way to remove such `serverTimezone`, `useSSL`, `characterEncoding` parameters ? They may cause lineage problems if other job uses same datasource but with different URI parameters
Beitragsleitfaden
Für dieses Repository ist kein Beitragsleitfaden indexiert
Bewertung
Dieses Issue wurde noch nicht bewertet.