[Bug] ODPS's schema_save_mode automatic table creation strategy is not taking effect for MaxCompute
- Dominant language
- Java
- Stars
- 9.7k
- Forks
- 2.4k
- Avg merge
- 3d 9h
- Merged PRs (30d)
- 204
Description
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
found out that the collection actually took effect, but the schema_save_mode policy did not take effect. It must ensure that the target table has been created to ensure that the collection takes effect. ODPS sink does not take effect when Maxcompute automatically creates a table and will report an error ODPS-0130131: Table not found table not found, requestId: null. After the task runs, it does not exit automatically and is still mounted on the front end. It needs to be manually canceled with ctrl c
### SeaTunnel Version
2.3.12
### SeaTunnel Config
```conf
env {
parallelism = 4
job.mode = "BATCH"
}
source {
Jdbc {
url = "jdbc:mysql://***.mysql.rds.aliyuncs.com:3306/***?serverTimezone=GMT%2b8&useUnicode=true&characterEncoding=UTF-8&rewriteBatchedStatements=true"
driver = "com.mysql.cj.jdbc.Driver"
connection_check_timeout_sec = 100
username = "***"
password = "***"
query = "select * from zbx_payment_info limit 16;"
}
}
transform {
}
sink {
Jdbc {
url = "jdbc:odps:http://***/api?project=***&accessId=***&accessKey=***"
driver = "com.aliyun.odps.jdbc.OdpsDriver"
generate_sink_sql = true
database = "***"
table_name = "***"
schema_save_mode = "RECREATE_SCHEMA"
data_save_mode = "APPEND_DATA"
batch_size = 256
max_retries = 3
connection_check_timeout_sec = 30
field_ide = "ORIGINAL"
auto_commit = true
}
}
```
### Running Command
```shell
bin/seatunnel.sh --config mysql2mc_test2.conf -m local
```
### Error Exception
```log
2025-11-11 12:29:03,093 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}] - [localhost]:5801 [seatunnel-309828] [5.1] taskDone, taskId = 1000300010001, taskGroup = TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}
2025-11-11 12:29:03,093 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}] - [localhost]:5801 [seatunnel-309828] [5.1] task 1000300010001 error with exception: [java.lang.RuntimeException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: com.aliyun.odps.UncheckedOdpsException: ODPS-0130131:Table not found - 'tcanalysis.zbx_payment_info' table not found, requestId: null], cancel other task in taskGroup TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}.
2025-11-11 12:29:03,093 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}] - [localhost]:5801 [seatunnel-309828] [5.1] Interrupted task 1000300000001 - org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask@207db678
2025-11-11 12:29:03,093 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}] - [localhost]:5801 [seatunnel-309828] [5.1] taskDone, taskId = 1000300000001, taskGroup = TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}
2025-11-11 12:29:03,094 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}] - [localhost]:5801 [seatunnel-309828] [5.1] taskGroup TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3} complete with FAILED
2025-11-11 12:29:03,094 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}] - [localhost]:5801 [seatunnel-309828] [5.1] task 1000300000001 error with exception: [java.lang.RuntimeException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: com.aliyun.odps.UncheckedOdpsException: ODPS-0130131:Table not found - 'tcanalysis.zbx_payment_info' table not found, requestId: null], cancel other task in taskGroup TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}.
2025-11-11 12:29:03,094 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-11] - [localhost]:5801 [seatunnel-309828] [5.1] Task TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3} complete with state FAILED
2025-11-11 12:29:03,094 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-11] - [localhost]:5801 [seatunnel-309828] [5.1] Received task end from execution TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}, state FAILED
2025-11-11 12:29:03,095 INFO [o.a.s.e.s.m.JobMaster ] [hz.main.seaTunnel.task.thread-11] - release the task group resource TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=3}
2025-11-11 12:29:03,095 INFO [a.s.e.s.s.s.DefaultSlotService] [hz.main.generic-operation.thread-5] - received slot release request, jobID: 1040483201945960449, slot: SlotProfile{worker=[localhost]:5801, slotID=19, ownerJobID=1040483201945960449, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='659e8347-435a-4505-8c1d-aa7c3ff9eff8'}
2025-11-11 12:29:03,095 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-8] - [localhost]:5801 [seatunnel-309828] [5.1] Task (TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=1}) need cancel.
2025-11-11 12:29:03,096 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=1}] - [localhost]:5801 [seatunnel-309828] [5.1] Interrupted task 1000100000000 - org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask@3cedf038
2025-11-11 12:29:03,096 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=1}] - [localhost]:5801 [seatunnel-309828] [5.1] taskDone, taskId = 1000100000000, taskGroup = TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=1}
2025-11-11 12:29:03,096 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-8] - [localhost]:5801 [seatunnel-309828] [5.1] Task (TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2}) need cancel.
2025-11-11 12:29:03,096 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2}] - [localhost]:5801 [seatunnel-309828] [5.1] Interrupted task 1000200010000 - org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask@5f4aea7b
2025-11-11 12:29:03,096 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2}] - [localhost]:5801 [seatunnel-309828] [5.1] Interrupted task 1000200000000 - org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask@364e0e5b
2025-11-11 12:29:03,096 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2}] - [localhost]:5801 [seatunnel-309828] [5.1] taskDone, taskId = 1000200010000, taskGroup = TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2}
2025-11-11 12:29:03,096 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2}] - [localhost]:5801 [seatunnel-309828] [5.1] taskDone, taskId = 1000200000000, taskGroup = TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2}
2025-11-11 12:29:03,097 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-8] - [localhost]:5801 [seatunnel-309828] [5.1] Task (TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4}) need cancel.
2025-11-11 12:29:03,098 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4}] - [localhost]:5801 [seatunnel-309828] [5.1] Interrupted task 1000400000002 - org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask@2cbdfe5d
2025-11-11 12:29:03,098 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4}] - [localhost]:5801 [seatunnel-309828] [5.1] Interrupted task 1000400010002 - org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask@70c05120
2025-11-11 12:29:03,098 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4}] - [localhost]:5801 [seatunnel-309828] [5.1] taskDone, taskId = 1000400000002, taskGroup = TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4}
2025-11-11 12:29:03,098 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4}] - [localhost]:5801 [seatunnel-309828] [5.1] taskDone, taskId = 1000400010002, taskGroup = TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4}
2025-11-11 12:29:03,098 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=1}] - [localhost]:5801 [seatunnel-309828] [5.1] taskGroup TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=1} complete with CANCELED
2025-11-11 12:29:03,098 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-12] - [localhost]:5801 [seatunnel-309828] [5.1] Task TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=1} complete with state CANCELED
2025-11-11 12:29:03,098 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-12] - [localhost]:5801 [seatunnel-309828] [5.1] Received task end from execution TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=1}, state CANCELED
2025-11-11 12:29:03,098 INFO [o.a.s.e.s.TaskExecutionService] [seatunnel-coordinator-service-8] - [localhost]:5801 [seatunnel-309828] [5.1] Task (TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5}) need cancel.
2025-11-11 12:29:03,098 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5}] - [localhost]:5801 [seatunnel-309828] [5.1] Interrupted task 1000500000003 - org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask@2cb4d275
2025-11-11 12:29:03,098 WARN [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5}] - [localhost]:5801 [seatunnel-309828] [5.1] Interrupted task 1000500010003 - org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask@4741caf
2025-11-11 12:29:03,098 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5}] - [localhost]:5801 [seatunnel-309828] [5.1] taskDone, taskId = 1000500000003, taskGroup = TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5}
2025-11-11 12:29:03,098 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5}] - [localhost]:5801 [seatunnel-309828] [5.1] taskDone, taskId = 1000500010003, taskGroup = TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5}
2025-11-11 12:29:03,099 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2}] - [localhost]:5801 [seatunnel-309828] [5.1] taskGroup TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2} complete with CANCELED
2025-11-11 12:29:03,099 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-12] - [localhost]:5801 [seatunnel-309828] [5.1] Task TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2} complete with state CANCELED
2025-11-11 12:29:03,099 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-12] - [localhost]:5801 [seatunnel-309828] [5.1] Received task end from execution TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2}, state CANCELED
2025-11-11 12:29:03,099 INFO [o.a.s.e.s.m.JobMaster ] [hz.main.seaTunnel.task.thread-12] - release the task group resource TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=2}
2025-11-11 12:29:03,099 INFO [a.s.e.s.s.s.DefaultSlotService] [hz.main.generic-operation.thread-7] - received slot release request, jobID: 1040483201945960449, slot: SlotProfile{worker=[localhost]:5801, slotID=17, ownerJobID=1040483201945960449, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='659e8347-435a-4505-8c1d-aa7c3ff9eff8'}
2025-11-11 12:29:03,099 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5}] - [localhost]:5801 [seatunnel-309828] [5.1] taskGroup TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5} complete with CANCELED
2025-11-11 12:29:03,099 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-12] - [localhost]:5801 [seatunnel-309828] [5.1] Task TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5} complete with state CANCELED
2025-11-11 12:29:03,100 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-12] - [localhost]:5801 [seatunnel-309828] [5.1] Received task end from execution TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5}, state CANCELED
2025-11-11 12:29:03,102 INFO [o.a.s.e.s.m.JobMaster ] [hz.main.seaTunnel.task.thread-12] - release the task group resource TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=5}
2025-11-11 12:29:03,102 INFO [o.a.s.e.s.TaskExecutionService] [BlockingWorker-TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4}] - [localhost]:5801 [seatunnel-309828] [5.1] taskGroup TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4} complete with CANCELED
2025-11-11 12:29:03,102 INFO [a.s.e.s.s.s.DefaultSlotService] [hz.main.generic-operation.thread-10] - received slot release request, jobID: 1040483201945960449, slot: SlotProfile{worker=[localhost]:5801, slotID=20, ownerJobID=1040483201945960449, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='659e8347-435a-4505-8c1d-aa7c3ff9eff8'}
2025-11-11 12:29:03,102 INFO [o.a.s.e.s.TaskExecutionService] [hz.main.seaTunnel.task.thread-9] - [localhost]:5801 [seatunnel-309828] [5.1] Task TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4} complete with state CANCELED
2025-11-11 12:29:03,103 INFO [o.a.s.e.s.CoordinatorService ] [hz.main.seaTunnel.task.thread-9] - [localhost]:5801 [seatunnel-309828] [5.1] Received task end from execution TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4}, state CANCELED
2025-11-11 12:29:03,103 INFO [o.a.s.e.s.m.JobMaster ] [hz.main.seaTunnel.task.thread-9] - release the task group resource TaskGroupLocation{jobId=1040483201945960449, pipelineId=1, taskGroupId=4}
2025-11-11 12:29:03,103 INFO [a.s.e.s.s.s.DefaultSlotService] [hz.main.generic-operation.thread-11] - received slot release request, jobID: 1040483201945960449, slot: SlotProfile{worker=[localhost]:5801, slotID=18, ownerJobID=1040483201945960449, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='659e8347-435a-4505-8c1d-aa7c3ff9eff8'}
2025-11-11 12:29:03,135 INFO [o.a.s.e.s.m.JobMaster ] [seatunnel-coordinator-service-8] - release the pipeline Job SeaTunnel_Job (1040483201945960449), Pipeline: [(1/1)] resource
2025-11-11 12:29:03,135 INFO [a.s.e.s.s.s.DefaultSlotService] [hz.main.generic-operation.thread-20] - received slot release request, jobID: 1040483201945960449, slot: SlotProfile{worker=[localhost]:5801, slotID=16, ownerJobID=1040483201945960449, assigned=true, resourceProfile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=0}}, sequence='659e8347-435a-4505-8c1d-aa7c3ff9eff8'}
2025-11-11 12:29:03,145 INFO [o.a.s.e.c.j.ClientJobProxy ] [main] - Job (1040483201945960449) end with state FAILED
2025-11-11 12:29:03,146 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-309828] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTTING_DOWN
2025-11-11 12:29:03,148 INFO [c.h.i.s.t.TcpServerConnection ] [hz.main.IO.thread-in-1] - [localhost]:5801 [seatunnel-309828] [5.1] Connection[id=1, /127.0.0.1:5801->/127.0.0.1:36991, qualifier=null, endpoint=[127.0.0.1]:36991, remoteUuid=d2434c73-a963-47a3-8e71-7c4e6f94e604, alive=false, connectionType=JVM, planeIndex=-1] closed. Reason: Connection closed by the other side
2025-11-11 12:29:03,148 INFO [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel-309828] [5.1] Removed connection to endpoint: [localhost]:5801:4b6158e1-3892-4783-9220-5848e003a91e, connection: ClientConnection{alive=false, connectionId=1, channel=NioChannel{/127.0.0.1:36991->localhost/127.0.0.1:5801}, remoteAddress=[localhost]:5801, lastReadTime=2025-11-11 12:29:03.144, lastWriteTime=2025-11-11 12:29:01.573, closedTime=2025-11-11 12:29:03.147, connected server version=5.1}
2025-11-11 12:29:03,149 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-309828] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is CLIENT_DISCONNECTED
2025-11-11 12:29:03,150 INFO [c.h.c.i.ClientEndpointManager ] [hz.main.event-2] - [localhost]:5801 [seatunnel-309828] [5.1] Destroying ClientEndpoint{connection=Connection[id=1, /127.0.0.1:5801->/127.0.0.1:36991, qualifier=null, endpoint=[127.0.0.1]:36991, remoteUuid=d2434c73-a963-47a3-8e71-7c4e6f94e604, alive=false, connectionType=JVM, planeIndex=-1], clientUuid=d2434c73-a963-47a3-8e71-7c4e6f94e604, clientName=hz.client_1, authenticated=true, clientVersion=5.1, creationTime=1762835326551, latest clientAttributes=lastStatisticsCollectionTime=1762835341571,enterprise=false,clientType=JVM,clientVersion=5.1,clusterConnectionTimestamp=1762835326545,clientAddress=127.0.0.1,clientName=hz.client_1,credentials.principal=null,os.committedVirtualMemorySize=33177702400,os.freePhysicalMemorySize=112213958656,os.freeSwapSpaceSize=4294963200,os.maxFileDescriptorCount=65536,os.openFileDescriptorCount=107,os.processCpuTime=21720000000,os.systemLoadAverage=0.28,os.totalPhysicalMemorySize=540352659456,os.totalSwapSpaceSize=4294963200,runtime.availableProcessors=128,runtime.freeMemory=341375848,runtime.maxMemory=477626368,runtime.totalMemory=390594560,runtime.uptime=17387,runtime.usedMemory=49218712, labels=[]}
2025-11-11 12:29:03,151 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [seatunnel-309828] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTDOWN
2025-11-11 12:29:03,151 INFO [c.h.c.LifecycleService ] [main] - [localhost]:5801 [seatunnel-309828] [5.1] [localhost]:5801 is SHUTTING_DOWN
2025-11-11 12:29:03,154 INFO [c.h.i.p.i.MigrationManager ] [hz.main.cached.thread-7] - [localhost]:5801 [seatunnel-309828] [5.1] Shutdown request of Member [localhost]:5801 - 4b6158e1-3892-4783-9220-5848e003a91e [master node] [active master] this is handled
2025-11-11 12:29:03,158 INFO [c.h.i.i.Node ] [main] - [localhost]:5801 [seatunnel-309828] [5.1] Shutting down connection manager...
2025-11-11 12:29:03,159 INFO [c.h.i.i.Node ] [main] - [localhost]:5801 [seatunnel-309828] [5.1] Shutting down node engine...
2025-11-11 12:29:03,182 INFO [c.h.i.i.NodeExtension ] [main] - [localhost]:5801 [seatunnel-309828] [5.1] Destroying node NodeExtension.
2025-11-11 12:29:03,182 INFO [c.h.i.i.Node ] [main] - [localhost]:5801 [seatunnel-309828] [5.1] Hazelcast Shutdown is completed in 29 ms.
2025-11-11 12:29:03,182 INFO [c.h.c.LifecycleService ] [main] - [localhost]:5801 [seatunnel-309828] [5.1] [localhost]:5801 is SHUTDOWN
Exception in thread "main" org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:228)
at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
at org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:40)
Caused by: org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException: java.lang.RuntimeException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: com.aliyun.odps.UncheckedOdpsException: ODPS-0130131:Table not found - 'tcanalysis.zbx_payment_info' table not found, requestId: null
at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:303)
at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:70)
at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:39)
at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:27)
at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.handleRecord(IntermediateBlockingQueue.java:77)
at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.collect(IntermediateBlockingQueue.java:56)
at org.apache.seatunnel.engine.server.task.flow.IntermediateQueueFlowLifeCycle.collect(IntermediateQueueFlowLifeCycle.java:51)
at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.collect(TransformSeaTunnelTask.java:72)
at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:165)
at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.call(TransformSeaTunnelTask.java:77)
at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:679)
at org.apache.seatunnel.engine.server.TaskExecutionService$NamedTaskWrapper.run(TaskExecutionService.java:1008)
at org.apache.seatunnel.api.tracing.MDCRunnable.run(MDCRunnable.java:43)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: com.aliyun.odps.UncheckedOdpsException: ODPS-0130131:Table not found - 'tcanalysis.zbx_payment_info' table not found, requestId: null
at org.apache.seatunnel.api.sink.multitablesink.MultiTableSinkWriter.prepareCommit(MultiTableSinkWriter.java:276)
at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:202)
... 17 more
Caused by: java.util.concurrent.ExecutionException: com.aliyun.odps.UncheckedOdpsException: ODPS-0130131:Table not found - 'tcanalysis.zbx_payment_info' table not found, requestId: null
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.seatunnel.api.sink.multitablesink.MultiTableSinkWriter.prepareCommit(MultiTableSinkWriter.java:274)
... 18 more
Caused by: com.aliyun.odps.UncheckedOdpsException: ODPS-0130131:Table not found - 'tcanalysis.zbx_payment_info' table not found, requestId: null
at com.aliyun.odps.Table.lazyLoadExtendInfo(Table.java:510)
at com.aliyun.odps.Table.isTransactional(Table.java:1209)
at com.aliyun.odps.jdbc.DataUploader.build(DataUploader.java:70)
at com.aliyun.odps.jdbc.OdpsPreparedStatement.parse(OdpsPreparedStatement.java:284)
at com.aliyun.odps.jdbc.OdpsPreparedStatement.executeBatch(OdpsPreparedStatement.java:202)
at org.apache.seatunnel.shade.com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127)
at org.apache.seatunnel.shade.com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java)
at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.executor.FieldNamedPreparedStatement.executeBatch(FieldNamedPreparedStatement.java:540)
at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.executor.SimpleBatchStatementExecutor.executeBatch(SimpleBatchStatementExecutor.java:54)
at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.executor.BufferedBatchStatementExecutor.executeBatch(BufferedBatchStatementExecutor.java:53)
at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.JdbcOutputFormat.attemptFlush(JdbcOutputFormat.java:172)
at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.JdbcOutputFormat.flush(JdbcOutputFormat.java:136)
at org.apache.seatunnel.connectors.seatunnel.jdbc.sink.JdbcSinkWriter.prepareCommit(JdbcSinkWriter.java:147)
at org.apache.seatunnel.api.sink.SinkWriter.prepareCommit(SinkWriter.java:75)
at org.apache.seatunnel.api.sink.multitablesink.MultiTableSinkWriter.lambda$prepareCommit$4(MultiTableSinkWriter.java:259)
... 6 more
Caused by: com.aliyun.odps.OdpsException: ODPS-0130131:Table not found - 'tcanalysis.zbx_payment_info' table not found
at com.aliyun.odps.Project.executeIfEpv2(Project.java:527)
at com.aliyun.odps.Table.lazyLoadExtendInfo(Table.java:501)
... 20 more
Caused by: com.aliyun.odps.ReloadException: ODPS-0130131:Table not found - 'tcanalysis.zbx_payment_info' table not found
at com.aliyun.odps.Table.reloadExtendInfo(Table.java:492)
at com.aliyun.odps.Table.lambda$lazyLoadExtendInfo$3(Table.java:505)
at com.aliyun.odps.Project.executeIfEpv2(Project.java:510)
... 21 more
Caused by: [404] com.aliyun.odps.NoSuchObjectException: ODPS-0130131:Table not found - 'tcanalysis.zbx_payment_info' table not found
at com.aliyun.odps.rest.RestClient.handleErrorResponse(RestClient.java:411)
at com.aliyun.odps.rest.RestClient.request(RestClient.java:350)
at com.aliyun.odps.rest.RestClient.request(RestClient.java:301)
at com.aliyun.odps.rest.RestClient.request(RestClient.java:255)
at com.aliyun.odps.rest.RestClient.request(RestClient.java:211)
at com.aliyun.odps.Table.reloadExtendInfo(Table.java:490)
... 23 more
Caused by: com.aliyun.odps.rest.RestException: RequestId=6912BB8F3D3BD319F5F9ABFE,Code=NoSuchObject,Message=ODPS-0130131:Table not found - 'tcanalysis.zbx_payment_info' table not found
... 29 more
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:220)
... 2 more
```
### Zeta or Flink or Spark Version
zeta2.3.12
### Java or Scala Version
java1.8
### Screenshots
_No response_
### Are you willing to submit PR?
- [x] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the ODPS sink configuration in the provided SeaTunnel job, focusing on schema_save_mode="RECREATE_SCHEMA" and the MaxCompute table-creation path. Reproduce the failure with mysql2mc_test2.conf and the local-mode command, then trace why the sink accesses the missing table. Done means the target table is created as configured and the job exits without manual cancellation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100