apache / apache/arrow

How to retrieve server logs and query progress in Flight SQL

Open
#13,988 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 18h
Merged PRs (30d)
91

Description

In big data cases(e.g. using Spark SQL to run batch jobs), a SQL may cost dozens of minutes or even hours to complete, how can the client retrieve server logs and progress information using Flight SQL protocol?

Contributor guide

Open the contributing guide

Research direction

Review the Flight SQL protocol and its client and server behavior for long-running Spark SQL jobs. Determine whether server logs and progress information are already exposed, then clarify the expected mechanism and whether the outcome should be an implementation, protocol change, or documentation; no files or tests are named in the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, spark, sql
Domain
api, backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.