debezium / debezium/dbz

Debezium MySQL Connector was not able to perform incremental loading when connected to MySQL Azure. [DBZ-3174]

Open
#429 0 comments 0 reactions 0 assignees View on GitHub
component/mysql-connector migrated-from-jira type/bug
Dominant language
HTML
Stars
6
Forks
9
Avg merge
2d 19h
Merged PRs (30d)
1

Description

Migrated from [DBZ-3174](https://issues.redhat.com/browse/DBZ-3174)

Debezium is working by connecting to the  Azure mysql  using  MySQL JDBC driver and it is recording events in topic but  failing to record insert,update and delete  operations of the data in the database and showing the exceptions as follows

org.apache.kafka.connect.errors.ConnectException: Failed to authenticate to the MySQL database at clicinsight.mysql.database.azure.com:3306 with user 'clic@clicinsight'
at io.debezium.connector.mysql.BinlogReader.doStart(BinlogReader.java:444)
at io.debezium.connector.mysql.AbstractReader.start(AbstractReader.java:127)
at io.debezium.connector.mysql.ChainedReader.startNextReader(ChainedReader.java:206)
at io.debezium.connector.mysql.ChainedReader.start(ChainedReader.java:103)
at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:272)
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:106)
at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:232)
at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:185)
at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:234)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: com.github.shyiko.mysql.binlog.network.AuthenticationException: The connection string may not be right. Please visit portal for references.
at com.github.shyiko.mysql.binlog.network.Authenticator.readResult(Authenticator.java:85)
at com.github.shyiko.mysql.binlog.network.Authenticator.authenticate(Authenticator.java:70)
at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:525)
at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:838)
... 1 more
Feb 23, 2021 11:44:19 PM com.github.shyiko.mysql.binlog.BinaryLogClient tryUpgradeToSSL
INFO: SSL enabled
[2021-02-23 23:44:19,965] ERROR WorkerSourceTask\{id=mysqlocal-debezzazure-connector-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask)
org.apache.kafka.connect.errors.ConnectException: Failed to authenticate to the MySQL database at clicinsight.mysql.database.azure.com:3306 with user 'clic@clicinsight'
at io.debezium.connector.mysql.BinlogReader.doStart(BinlogReader.java:444)
at io.debezium.connector.mysql.AbstractReader.start(AbstractReader.java:127)
at io.debezium.connector.mysql.ChainedReader.startNextReader(ChainedReader.java:206)
at io.debezium.connector.mysql.ChainedReader.start(ChainedReader.java:103)
at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:272)
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:106)
at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:232)
at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:185)
at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:234)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: com.github.shyiko.mysql.binlog.network.AuthenticationException: The connection string may not be right. Please visit portal for references.
at com.github.shyiko.mysql.binlog.network.Authenticator.readResult(Authenticator.java:85)
at com.github.shyiko.mysql.binlog.network.Authenticator.authenticate(Authenticator.java:70)
at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:525)
at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:838)
... 1 more

 

 

+{color:#de350b}*and connector is*{color}+ 

 

{"name":"mysqlocal-debezzazure-connector","connector":\{"state":"RUNNING","worker_id":"192.168.0.195:8083"},"tasks":[\{"id":0,"state":"FAILED","worker_id":"192.168.0.195:8083","trace":"org.apache.kafka.connect.errors.ConnectException: Failed to authenticate to the MySQL database at clicinsight.mysql.database.azure.com:3306 with user 'clic@clicinsight'\r\n\tat io.debezium.connector.mysql.BinlogReader.doStart(BinlogReader.java:444)\r\n\tat io.debezium.connector.mysql.AbstractReader.start(AbstractReader.java:127)\r\n\tat io.debezium.connector.mysql.ChainedReader.startNextReader(ChainedReader.java:206)\r\n\tat io.debezium.connector.mysql.ChainedReader.start(ChainedReader.java:103)\r\n\tat io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:272)\r\n\tat io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:106)\r\n\tat org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:232)\r\n\tat org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:185)\r\n\tat org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:234)\r\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)\r\n\tat java.util.concurrent.FutureTask.run(Unknown Source)\r\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)\r\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)\r\n\tat java.lang.Thread.run(Unknown Source)\r\nCaused by: com.github.shyiko.mysql.binlog.network.AuthenticationException: The connection string may not be right. Please visit portal for references.\u0000\r\n\tat com.github.shyiko.mysql.binlog.network.Authenticator.readResult(Authenticator.java:85)\r\n\tat com.github.shyiko.mysql.binlog.network.Authenticator.authenticate(Authenticator.java:70)\r\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:525)\r\n\tat com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:838)\r\n\t... 1 more\r\n"}],"type":"source"}[^debez-controler.json]

 

 

 

 

Contributor guide

Open the contributing guide

Research direction

Start with io/debezium/connector/mysql/BinlogReader.java and the MySqlConnectorTask.java stack-trace entry points, then review the MySQL JDBC and Azure MySQL connection details described in the report. Reproduce the connector configuration and authentication failure against Azure MySQL; done means incremental insert, update, and delete events are recorded without the reported task failure.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, java, mysql
Domain
backend, cloud, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.