apache / apache/kyuubi

Query execution report

Open
#698 0 comments 2 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
2.4k
Forks
1k
PR merge metrics
No merged PRs in 30d

Description

### 1. Describe the feature
Produce an execution report dynamically for each query. The content of report could include:
* runtime statistics (e.g. input/output bytes)
* resouce usage
* exception analysis
* suggestion of optimization

### 2. Motivation
It's a bit hard for data developers to some trouble shooting or SQL optimization which requires a lot of knowledge of Apache Spark or other engine.

Kyuubi can provide a friendly report for every engine and every SQL query.

### 3. Describe the solution
Collect the engine metrics and some key log is always the first step. Then we can use these data to do analysis with near real-time.

### 4. Additional context
We may need UI to show the report.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.