alibaba / alibaba/DataX

mysqlreader不支持fetchsize的话,抽取数据是否只执行一次sql

Open
#1,956 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

我指定了where条件 create_time between '2022-10-13 00:00:00' and '2023-10-13 00:00:00'
一年中的数据量达几千万条,是否会有oom的问题呢?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the MySQLReader handling for fetchsize and the date-range query described in the issue. Verify whether the query is executed once, how the result set is consumed, and whether the reported workload has coverage; done means answering the execution and OOM questions with evidence.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.