apache / apache/datafusion-python

Surface foreign ExecutionPlan metrics via FFI (FFI_MetricsSet)

未關閉
#1,576 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Python
星號
604
分支
174
平均合併
1 天 7 小時
30 天內合併 PR
4

描述

## Background

`PyMetricsSet` currently wraps the native DataFusion `MetricsSet` only. When a foreign `ExecutionPlan` is imported through `FFI_ExecutionPlan` (for example a plan implemented in a separate Rust extension, Go, or another Python module), there is no FFI round-trip for metrics: ``plan.metrics()`` on such a foreign plan returns whatever the underlying implementation happens to populate, with no standard way for the foreign side to surface DataFusion-style metrics back across the boundary.

## Why deferred

There is no `FFI_MetricsSet` struct in the upstream `datafusion-ffi` crate at v54 to wrap; this is a pipeline-symmetry concern rather than a feature gap with a clear upstream target. No open user requests at the time of audit. Filed for tracking so that when upstream lands FFI metrics support, the Python bindings can pick it up immediately. The accepted path is probably: upstream adds `FFI_MetricsSet` and threads it through `FFI_ExecutionPlan::metrics`; the Python bindings then expose a `from_pycapsule` helper on `MetricsSet` analogous to the other `*Exportable` patterns.

貢獻指南

這個儲存庫沒有索引到貢獻指南

研究方向

Start by checking the upstream datafusion-ffi crate beyond v54 for an FFI_MetricsSet and its connection to FFI_ExecutionPlan::metrics. Then inspect the Python MetricsSet and existing *Exportable from_pycapsule patterns. The work is complete when foreign execution-plan metrics can cross the FFI boundary and be exposed by the Python bindings.

由索引模型根據 Issue 內容生成。

評估

技術堆疊
python, rust
領域
backend-api-design, data-engineering
Issue 類型
功能
難度
5/5
預估耗時
一週以上
活躍度
冷清
描述清晰度
需要釐清
新手友好度
25/100

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。