apache / apache/seatunnel

Vscode start SeaTunnelEngineLocalExample failed, Help Needed

Open
#9,604 1 comment 0 reactions 0 assignees View on GitHub
stale
Dominant language
Java
Stars
9.7k
Forks
2.4k
Avg merge
3d 13h
Merged PRs (30d)
203

Description

1、using .vscode/launch.json, start debug, lots of compile error.
{
"version": "0.2.0",
"configurations": [
{
"type": "java",
"name": "Debug SeaTunnelEngineLocalExample",
"request": "launch",
"mainClass": "org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample",
"cwd": "${workspaceFolder}",
"console": "internalConsole"
}
]
}

**2、using mvn to run, I got "Unable to create a source for identifier 'MySQL-CDC'." error.**
mvn -pl seatunnel-examples/seatunnel-engine-examples exec:java -Dexec.mainClass="org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample"

env {
parallelism = 1
job.mode = "STREAMING"
checkpoint.interval = 10000
}

source {
MySQL-CDC {
plugin_output = "mysql-cdc"
base-url = "jdbc:mysql://127.0.0.1:3306/test"
username = "root"
password = "123456"
table-names = ["test.user"]

startup.mode = "initial"
}
}

transform {
}
sink {
Console {
plugin_input = "mysql-cdc"
}
}

I got "Unable to create a source for identifier 'MySQL-CDC'." error.
I have put plugins in lib 、connectors、plugins directory.

[] 2025-07-22 10:44:50,248 INFO org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand - Closed HazelcastInstance ......
[] 2025-07-22 10:44:50,248 ERROR org.apache.seatunnel.core.starter.SeaTunnel -

===============================================================================

[] 2025-07-22 10:44:50,248 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Fatal Error,

[] 2025-07-22 10:44:50,248 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Please submit bug report in https://github.com/apache/seatunnel/issues

[] 2025-07-22 10:44:50,248 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Reason:SeaTunnel job executed failed

[] 2025-07-22 10:44:50,253 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Exception StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:228)
at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
at org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample.main(SeaTunnelEngineLocalExample.java:48)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:279)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.seatunnel.api.table.factory.FactoryException: ErrorCode:[API-06], ErrorDescription:[Factory initialize failed] - Unable to create a source for identifier 'MySQL-CDC'.
at org.apache.seatunnel.api.table.factory.FactoryUtil.restoreAndPrepareSource(FactoryUtil.java:168)
at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource(FactoryUtil.java:86)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSource(MultipleTableJobConfigParser.java:376)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse(MultipleTableJobConfigParser.java:227)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.getLogicalDag(ClientJobExecutionEnvironment.java:123)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.execute(ClientJobExecutionEnvironment.java:191)
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:165)
... 4 more
Caused by: org.apache.seatunnel.api.table.catalog.exception.CatalogException: ErrorCode:[API-03], ErrorDescription:[Catalog initialize failed] - Failed connecting to jdbc:mysql://127.0.0.1:3306/casdoor via JDBC.
at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.AbstractJdbcCatalog.getConnection(AbstractJdbcCatalog.java:159)
at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.AbstractJdbcCatalog.open(AbstractJdbcCatalog.java:165)
at org.apache.seatunnel.api.table.catalog.CatalogTableUtil.lambda$getCatalogTables$0(CatalogTableUtil.java:122)
at java.base/java.util.Optional.map(Optional.java:265)
at org.apache.seatunnel.api.table.catalog.CatalogTableUtil.getCatalogTables(CatalogTableUtil.java:118)
at org.apache.seatunnel.api.table.catalog.CatalogTableUtil.getCatalogTables(CatalogTableUtil.java:98)
at org.apache.seatunnel.connectors.seatunnel.cdc.mysql.source.MySqlIncrementalSourceFactory.lambda$restoreSource$2(MySqlIncrementalSourceFactory.java:107)
at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource(FactoryUtil.java:180)
at org.apache.seatunnel.api.table.factory.FactoryUtil.restoreAndPrepareSource(FactoryUtil.java:136)
... 10 more
Caused by: java.sql.SQLException: not a valid url
at com._4paradigm.openmldb.jdbc.SQLDriver.parseAndMergeClusterProps(SQLDriver.java:84)
at com._4paradigm.openmldb.jdbc.SQLDriver.connect(SQLDriver.java:52)
at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:228)
at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.AbstractJdbcCatalog.getConnection(AbstractJdbcCatalog.java:155)
... 18 more

[] 2025-07-22 10:44:50,254 ERROR org.apache.seatunnel.core.starter.SeaTunnel -
===============================================================================

[WARNING]
org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute (ClientExecuteCommand.java:228)
at org.apache.seatunnel.core.starter.SeaTunnel.run (SeaTunnel.java:40)
at org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample.main (SeaTunnelEngineLocalExample.java:48)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:279)
at java.lang.Thread.run (Thread.java:829)
Caused by: org.apache.seatunnel.api.table.factory.FactoryException: ErrorCode:[API-06], ErrorDescription:[Factory initialize failed] - Unable to create a source for identifier 'MySQL-CDC'.
at org.apache.seatunnel.api.table.factory.FactoryUtil.restoreAndPrepareSource (FactoryUtil.java:168)
at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource (FactoryUtil.java:86)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSource (MultipleTableJobConfigParser.java:376)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse (MultipleTableJobConfigParser.java:227)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.getLogicalDag (ClientJobExecutionEnvironment.java:123)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.execute (ClientJobExecutionEnvironment.java:191)
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute (ClientExecuteCommand.java:165)
at org.apache.seatunnel.core.starter.SeaTunnel.run (SeaTunnel.java:40)
at org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample.main (SeaTunnelEngineLocalExample.java:48)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:279)
at java.lang.Thread.run (Thread.java:829)
Caused by: org.apache.seatunnel.api.table.catalog.exception.CatalogException: ErrorCode:[API-03], ErrorDescription:[Catalog initialize failed] - Failed connecting to jdbc:mysql://127.0.0.1:3306/casdoor via JDBC.
at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.AbstractJdbcCatalog.getConnection (AbstractJdbcCatalog.java:159)
at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.AbstractJdbcCatalog.open (AbstractJdbcCatalog.java:165)
at org.apache.seatunnel.api.table.catalog.CatalogTableUtil.lambda$getCatalogTables$0 (CatalogTableUtil.java:122)
at java.util.Optional.map (Optional.java:265)
at org.apache.seatunnel.api.table.catalog.CatalogTableUtil.getCatalogTables (CatalogTableUtil.java:118)
at org.apache.seatunnel.api.table.catalog.CatalogTableUtil.getCatalogTables (CatalogTableUtil.java:98)
at org.apache.seatunnel.connectors.seatunnel.cdc.mysql.source.MySqlIncrementalSourceFactory.lambda$restoreSource$2 (MySqlIncrementalSourceFactory.java:107)
at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource (FactoryUtil.java:180)
at org.apache.seatunnel.api.table.factory.FactoryUtil.restoreAndPrepareSource (FactoryUtil.java:136)
at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource (FactoryUtil.java:86)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSource (MultipleTableJobConfigParser.java:376)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse (MultipleTableJobConfigParser.java:227)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.getLogicalDag (ClientJobExecutionEnvironment.java:123)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.execute (ClientJobExecutionEnvironment.java:191)
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute (ClientExecuteCommand.java:165)
at org.apache.seatunnel.core.starter.SeaTunnel.run (SeaTunnel.java:40)
at org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample.main (SeaTunnelEngineLocalExample.java:48)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:279)
at java.lang.Thread.run (Thread.java:829)
Caused by: java.sql.SQLException: not a valid url
at com._4paradigm.openmldb.jdbc.SQLDriver.parseAndMergeClusterProps (SQLDriver.java:84)
at com._4paradigm.openmldb.jdbc.SQLDriver.connect (SQLDriver.java:52)
at java.sql.DriverManager.getConnection (DriverManager.java:677)
at java.sql.DriverManager.getConnection (DriverManager.java:228)
at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.AbstractJdbcCatalog.getConnection (AbstractJdbcCatalog.java:155)
at org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.AbstractJdbcCatalog.open (AbstractJdbcCatalog.java:165)
at org.apache.seatunnel.api.table.catalog.CatalogTableUtil.lambda$getCatalogTables$0 (CatalogTableUtil.java:122)
at java.util.Optional.map (Optional.java:265)
at org.apache.seatunnel.api.table.catalog.CatalogTableUtil.getCatalogTables (CatalogTableUtil.java:118)
at org.apache.seatunnel.api.table.catalog.CatalogTableUtil.getCatalogTables (CatalogTableUtil.java:98)
at org.apache.seatunnel.connectors.seatunnel.cdc.mysql.source.MySqlIncrementalSourceFactory.lambda$restoreSource$2 (MySqlIncrementalSourceFactory.java:107)
at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource (FactoryUtil.java:180)
at org.apache.seatunnel.api.table.factory.FactoryUtil.restoreAndPrepareSource (FactoryUtil.java:136)
at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource (FactoryUtil.java:86)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSource (MultipleTableJobConfigParser.java:376)
at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse (MultipleTableJobConfigParser.java:227)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.getLogicalDag (ClientJobExecutionEnvironment.java:123)
at org.apache.seatunnel.engine.client.job.ClientJobExecutionEnvironment.execute (ClientJobExecutionEnvironment.java:191)
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute (ClientExecuteCommand.java:165)
at org.apache.seatunnel.core.starter.SeaTunnel.run (SeaTunnel.java:40)
at org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample.main (SeaTunnelEngineLocalExample.java:48)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:279)
at java.lang.Thread.run (Thread.java:829)
[] 2025-07-22 10:44:51,831 WARN org.apache.hadoop.fs.FileSystem - Cleaner thread interrupted, will stop
java.lang.InterruptedException: null
at java.lang.Object.wait(Native Method) ~[?:?]
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155) ~[?:?]
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176) ~[?:?]
at org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3760) [hadoop-common-3.1.4.jar:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
[WARNING] thread Thread[Log4j2-TF-2-Scheduled-1,5,org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample] was interrupted but is still alive after waiting at least 15000msecs
[WARNING] thread Thread[Log4j2-TF-2-Scheduled-1,5,org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample] will linger despite being asked to die via interruption
[WARNING] thread Thread[SeaTunnel-CompletableFuture-Thread-0,5,org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample] will linger despite being asked to die via interruption
[WARNING] thread Thread[SeaTunnel-CompletableFuture-Thread-1,5,org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample] will linger despite being asked to die via interruption
[WARNING] NOTE: 3 thread(s) did not finish despite being asked to via interruption. This is not a problem with exec:java, it is a problem with the running code. Although not serious, it should be remedied.
[WARNING] Couldn't destroy threadgroup org.codehaus.mojo.exec.ExecJavaMojo$IsolatedThreadGroup[name=org.apache.seatunnel.example.engine.SeaTunnelEngineLocalExample,maxpri=10]
java.lang.IllegalThreadStateException
at java.lang.ThreadGroup.destroy (ThreadGroup.java:776)
at org.codehaus.mojo.exec.ExecJavaMojo.execute (ExecJavaMojo.java:319)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:126)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:328)
at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:316)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:212)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:174)
at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:75)
at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:162)
at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:159)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:906)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:566)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:255)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:201)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:361)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:314)
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 22.938 s
[INFO] Finished at: 2025-07-22T10:45:06+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:3.1.0:java (default-cli) on project seatunnel-engine-examples: An exception occurred while executing the Java class. SeaTunnel job executed failed: ErrorCode:[API-06], ErrorDescription:[Factory initialize failed] - Unable to create a source for identifier 'MySQL-CDC'. ErrorCode:[API-03], ErrorDescription:[Catalog initialize failed] - Failed connecting to jdbc:mysql://127.0.0.1:3306/casdoor via JDBC. not a valid url -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[WARNING]
java.lang.NoClassDefFoundError: org/apache/hadoop/util/ShutdownHookManager$2
at org.apache.hadoop.util.ShutdownHookManager.getShutdownHooksInOrder (ShutdownHookManager.java:275)
at org.apache.hadoop.util.ShutdownHookManager.executeShutdown (ShutdownHookManager.java:121)
at org.apache.hadoop.util.ShutdownHookManager$1.run (ShutdownHookManager.java:95)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.ShutdownHookManager$2
at org.codehaus.mojo.exec.URLClassLoaderBuilder$ExecJavaClassLoader.loadClass (URLClassLoaderBuilder.java:198)
at java.lang.ClassLoader.loadClass (ClassLoader.java:527)
at org.apache.hadoop.util.ShutdownHookManager.getShutdownHooksInOrder (ShutdownHookManager.java:275)
at org.apache.hadoop.util.ShutdownHookManager.executeShutdown (ShutdownHookManager.java:121)
at org.apache.hadoop.util.ShutdownHookManager$1.run (ShutdownHookManager.java:95)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with seatunnel-examples/seatunnel-engine-examples and the SeaTunnelEngineLocalExample.main stack trace, then inspect FactoryUtil and MySqlIncrementalSourceFactory around source creation. Reproduce both the VS Code launch and the Maven exec command, checking the reported compile and JDBC errors. Done means the local example starts and the MySQL-CDC source initializes successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
backend, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.