AbsaOSS / AbsaOSS/spline-spark-agent

Removing unnecessary parameters from JDBC URIs

Open
#98 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
210
Forks
102
Avg merge
1d 1h
Merged PRs (30d)
1

Description

When spark is reading/writing with JDBC datasource spline reports its URI to lineage - that's greate because database and table are visible there

Unfortunately some non-datasource-identifing parameters are also added in that URI, for example:

`jdbc:mysql://host:3336/my_database?serverTimezone=Poland&useSSL=false&characterEncoding=utf8:my_table`

Not sure if there's generic way to remove such `serverTimezone`, `useSSL`, `characterEncoding` parameters ? They may cause lineage problems if other job uses same datasource but with different URI parameters

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.