Mysql Sink Worker ratio is highly unbalanced
Open
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 56
- Forks
- 63
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 34
Description
in tcms test sysbench, the mysql sink is not faster enough to make lag down. Besides, the worker ratio of workers is quite unbalanced, which exist some optimization space for better performance.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the tcms sysbench test and the attached worker-ratio results, then trace the MySQL sink worker allocation and how it affects lag. Measure whether the worker distribution becomes more balanced and whether sink throughput improves enough to reduce lag.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go, mysql
- Domain
- data-engineering, performance
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100