Debezium MySQL Connector was not able to perform incremental loading when connected to MySQL Azure. [DBZ-3174]
- Dominant language
- HTML
- Stars
- 6
- Forks
- 9
- Avg merge
- 2d 19h
- Merged PRs (30d)
- 1
Description
Migrated from [DBZ-3174](https://issues.redhat.com/browse/DBZ-3174)
Debezium is working by connecting to the Azure mysql using MySQL JDBC driver and it is recording events in topic but failing to record insert,update and delete operations of the data in the database and showing the exceptions as follows
org.apache.kafka.connect.errors.ConnectException: Failed to authenticate to the MySQL database at clicinsight.mysql.database.azure.com:3306 with user 'clic@clicinsight'
at io.debezium.connector.mysql.BinlogReader.doStart(BinlogReader.java:444)
at io.debezium.connector.mysql.AbstractReader.start(AbstractReader.java:127)
at io.debezium.connector.mysql.ChainedReader.startNextReader(ChainedReader.java:206)
at io.debezium.connector.mysql.ChainedReader.start(ChainedReader.java:103)
at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:272)
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:106)
at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:232)
at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:185)
at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:234)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: com.github.shyiko.mysql.binlog.network.AuthenticationException: The connection string may not be right. Please visit portal for references.
at com.github.shyiko.mysql.binlog.network.Authenticator.readResult(Authenticator.java:85)
at com.github.shyiko.mysql.binlog.network.Authenticator.authenticate(Authenticator.java:70)
at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:525)
at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:838)
... 1 more
Feb 23, 2021 11:44:19 PM com.github.shyiko.mysql.binlog.BinaryLogClient tryUpgradeToSSL
INFO: SSL enabled
[2021-02-23 23:44:19,965] ERROR WorkerSourceTask\{id=mysqlocal-debezzazure-connector-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask)
org.apache.kafka.connect.errors.ConnectException: Failed to authenticate to the MySQL database at clicinsight.mysql.database.azure.com:3306 with user 'clic@clicinsight'
at io.debezium.connector.mysql.BinlogReader.doStart(BinlogReader.java:444)
at io.debezium.connector.mysql.AbstractReader.start(AbstractReader.java:127)
at io.debezium.connector.mysql.ChainedReader.startNextReader(ChainedReader.java:206)
at io.debezium.connector.mysql.ChainedReader.start(ChainedReader.java:103)
at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:272)
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:106)
at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:232)
at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:185)
at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:234)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: com.github.shyiko.mysql.binlog.network.AuthenticationException: The connection string may not be right. Please visit portal for references.
at com.github.shyiko.mysql.binlog.network.Authenticator.readResult(Authenticator.java:85)
at com.github.shyiko.mysql.binlog.network.Authenticator.authenticate(Authenticator.java:70)
at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:525)
at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:838)
... 1 more
+{color:#de350b}*and connector is*{color}+
{"name":"mysqlocal-debezzazure-connector","connector":\{"state":"RUNNING","worker_id":"192.168.0.195:8083"},"tasks":[\{"id":0,"state":"FAILED","worker_id":"192.168.0.195:8083","trace":"org.apache.kafka.connect.errors.ConnectException: Failed to authenticate to the MySQL database at clicinsight.mysql.database.azure.com:3306 with user 'clic@clicinsight'\r\n\tat io.debezium.connector.mysql.BinlogReader.doStart(BinlogReader.java:444)\r\n\tat io.debezium.connector.mysql.AbstractReader.start(AbstractReader.java:127)\r\n\tat io.debezium.connector.mysql.ChainedReader.startNextReader(ChainedReader.java:206)\r\n\tat io.debezium.connector.mysql.ChainedReader.start(ChainedReader.java:103)\r\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:272)\r\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:106)\r\n\tat org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:232)\r\n\tat org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:185)\r\n\tat org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:234)\r\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)\r\n\tat java.util.concurrent.FutureTask.run(Unknown Source)\r\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)\r\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)\r\n\tat java.lang.Thread.run(Unknown Source)\r\nCaused by: com.github.shyiko.mysql.binlog.network.AuthenticationException: The connection string may not be right. Please visit portal for references.\u0000\r\n\tat com.github.shyiko.mysql.binlog.network.Authenticator.readResult(Authenticator.java:85)\r\n\tat com.github.shyiko.mysql.binlog.network.Authenticator.authenticate(Authenticator.java:70)\r\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:525)\r\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:838)\r\n\t... 1 more\r\n"}],"type":"source"}[^debez-controler.json]
Contributor guide
Research direction
Start with io/debezium/connector/mysql/BinlogReader.java and the MySqlConnectorTask.java stack-trace entry points, then review the MySQL JDBC and Azure MySQL connection details described in the report. Reproduce the connector configuration and authentication failure against Azure MySQL; done means incremental insert, update, and delete events are recorded without the reported task failure.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, java, mysql
- Domain
- backend, cloud, databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100