alibaba / alibaba/DataX

为什么hdfsreader进行record限速时会翻一倍

Open
#1,616 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

限速40byte/s,会变成80byte/s左右

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the HDFSReader record-rate limiting path and reproduce the reported configuration of 40 byte/s. Compare the configured rate with observed throughput and identify the relevant existing tests or entry points; done when a test demonstrates that record limiting stays near the configured rate.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.