alibaba / alibaba/DataX

datax是单进程还是多进程, 多线程会释放单例对象资源

Open
#2,272 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

我有个自定义transformer, 从MySQL加密到MySQL另一个数据库表, 有一个单例的加密对象, 在多线程下, datax会释放掉该加密对象(调用close()方法), 导致其他任务加密失败,想问一下datax多线程下是如何执行transform的

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing DataX's transformer lifecycle and multithreaded execution for the custom MySQL-to-MySQL job. Check when the singleton encryption object's close() method is called and whether workers share it; done means explaining why another task then fails and identifying the relevant lifecycle behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.