ArrowBuf copying from GetReadableBuffer causes slowness
- 主要语言
- Java
- 星标
- 94
- 派生
- 152
- 平均合并
- 3 天 16 小时
- 30 天内合并 PR
- 11
描述
### Describe the usage question you have. Please include as many useful details as possible.
I'm using Arrow Flight and discovered an extra copy action while testing performance impact.
` ReadableBuffer readableBuffer = fastPath ? getReadableBuffer(stream) : null;
if (readableBuffer != null) {
readableBuffer.readBytes(buf.nioBuffer(0, size));
} `
The flame graph shows that after enabling zero_copy, ArrowBuf copying from GetReadableBuffer causes slowness.
Why does this copy occur?
Or is it because arrowbuf needs to manage its own memory, so the ownership must be transferred from netty?
### Component(s)
FlightRPC
贡献指南
调研方向
从 issue 中展示的 FlightRPC 快速路径开始,沿着 getReadableBuffer 经过 ReadableBuffer.readBytes 跟踪到 ArrowBuf 目标,同时对照报告中的火焰图。确定复制是否是所有权或内存管理所必需的,并记录原因,或记录一种有明确支持的避免复制的方法。
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- java
- 领域
- api, performance
- Issue 类型
- 缺陷
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 活跃度
- 停滞
- 描述清晰度
- 需要澄清
- 新手友好度
- 35/100