apache / apache/datafusion-python

Surface foreign ExecutionPlan metrics via FFI (FFI_MetricsSet)

Aberta
#1,576 0 comentários 0 reações 0 responsáveis Ver no GitHub
Linguagem predominante
Python
Estrelas
604
Forks
174
Merge médio
1d 7h
PRs com merge (30d)
4

Descrição

## Background

`PyMetricsSet` currently wraps the native DataFusion `MetricsSet` only. When a foreign `ExecutionPlan` is imported through `FFI_ExecutionPlan` (for example a plan implemented in a separate Rust extension, Go, or another Python module), there is no FFI round-trip for metrics: ``plan.metrics()`` on such a foreign plan returns whatever the underlying implementation happens to populate, with no standard way for the foreign side to surface DataFusion-style metrics back across the boundary.

## Why deferred

There is no `FFI_MetricsSet` struct in the upstream `datafusion-ffi` crate at v54 to wrap; this is a pipeline-symmetry concern rather than a feature gap with a clear upstream target. No open user requests at the time of audit. Filed for tracking so that when upstream lands FFI metrics support, the Python bindings can pick it up immediately. The accepted path is probably: upstream adds `FFI_MetricsSet` and threads it through `FFI_ExecutionPlan::metrics`; the Python bindings then expose a `from_pycapsule` helper on `MetricsSet` analogous to the other `*Exportable` patterns.

Guia de contribuição

Nenhum guia de contribuição indexado para este repositório

Direção de pesquisa

Start by checking the upstream datafusion-ffi crate beyond v54 for an FFI_MetricsSet and its connection to FFI_ExecutionPlan::metrics. Then inspect the Python MetricsSet and existing *Exportable from_pycapsule patterns. The work is complete when foreign execution-plan metrics can cross the FFI boundary and be exposed by the Python bindings.

Escrita pelo modelo de indexação a partir do texto da issue.

Avaliação

Stack de tecnologia
python, rust
Domínio
backend-api-design, data-engineering
Tipo de issue
Funcionalidade
Dificuldade
5/5
Tempo estimado
Mais de uma semana
Status de atividade
Pouca atividade
Clareza
Precisa de esclarecimento
Facilidade para iniciantes
25/100

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.