apache / apache/gluten

[CORE] SparkPlan without logicalLink does not show correct fallback reason on UI

Open
#8,596 2 comments 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Bug description

Currently, set the fallback reason to logical plan
https://github.com/apache/incubator-gluten/blob/0f4489aeccb691abc2f739b7d7a1f4cb0037c093/gluten-substrait/src/main/scala/org/apache/spark/sql/execution/GlutenFallbackReporter.scala#L54-L69.
There is a problem with this, SparkPlan without logicalLink does not show correct fallback reason on UI.
Some additional nodes may be generated in gluten's rules, such as project generated by PushDownInputFileExpression.

### Spark version

None

### Spark configurations

_No response_

### System information

_No response_

### Relevant logs

```bash

```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.