apache / apache/seatunnel

[HELP] What is the max read/write speed when using local mode with jdbc connector

Open
#9,897 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
9.7k
Forks
2.4k
Avg merge
3d 13h
Merged PRs (30d)
203

Description

We would like to know if possible to use local mode for some really intensive sync job, and if possible to tweak the current job configuration to achieve higher performance. How does it work underneath and is there some benchmark for it?

Would also be nice to get more knowledge about Zeta, what read/write speed it can achieve.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names local mode, the JDBC connector, job configuration, and Zeta, but no source files or tests. Start by locating the local-mode and JDBC connector entry points, then identify how throughput is measured; done means documenting the execution model, achievable read/write speeds, benchmark results, and relevant configuration limits.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, databases, performance
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.