apache / apache/arrow-java

[Java][FlightRPC] Flight SQL JDBC driver does not expose per-batch app_metadata from FlightStream

未關閉
#1,089 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
Type: enhancement
主要語言
Java
星號
94
分支
152
平均合併
3 天 16 小時
30 天內合併 PR
11

描述

### Summary
The Flight SQL JDBC driver (flight-sql-jdbc-driver) currently exposes FlightInfo.app_metadata via ArrowFlightJdbcFlightStreamResultSet.getAppMetadata() (added in ~15.0), but per-batch app_metadata from FlightStream.getLatestMetadata() is received internally and silently discarded — it is never surfaced to JDBC callers.

### Motivation
Servers use per-batch app_metadata on FlightData messages to communicate execution statistics (rows scanned, elapsed time, query state, etc.) — similar to what Trino exposes via QueryStats. This is particularly valuable for the final batch, which servers commonly use as a "trailing metadata" pattern to report post-execution stats.
Currently there is no way to access this information through the JDBC layer without dropping down to the raw FlightClient, which defeats the purpose of the JDBC driver abstraction.

### Current behavior

FlightInfo.app_metadata → accessible via rs.unwrap(ArrowFlightJdbcFlightStreamResultSet.class).getAppMetadata() ✅
Per-batch FlightData.app_metadata → received by FlightStream.getLatestMetadata() internally, but never stored or exposed ❌

**Also worth noting**: getAppMetadata() returns a snapshot from query submission time only. For long-running queries using PollFlightInfo, updated app_metadata from subsequent poll cycles is never surfaced. This limits its usefulness for engines that progressively update stats during execution.

### Requested change
Add a method to ArrowFlightJdbcFlightStreamResultSet (accessible via unwrap()) such as:
```
public ArrowBuf getLatestBatchMetadata() {
if (currentEndpointData == null || currentEndpointData.getStream() == null) {
return null;
}
return currentEndpointData.getStream().getLatestMetadata();
}
```
This would follow the same unwrap() pattern already established for getAppMetadata() and give callers access to per-batch metadata, including trailing stats on the final batch.

### Component(s)

FlightRPC, Java

貢獻指南

開啟貢獻指南

研究方向

從 ArrowFlightJdbcFlightStreamResultSet 及其現有的 getAppMetadata() 方法開始,然後追蹤 currentEndpointData 和 FlightStream.getLatestMetadata()。完成標準是 JDBC 呼叫端可以使用 unwrap() 取得最新的每批次中繼資料,包括最後一個批次的尾端中繼資料,而無需存取原始的 FlightClient。

由索引模型根據 Issue 內容生成。

評估

技術堆疊
java, sql
領域
api, database
Issue 類型
功能
難度
3/5
預估耗時
1-2 天
活躍度
冷清
描述清晰度
描述清楚
新手友好度
75/100

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。