apache / apache/gluten

Spark 4.x: Tracking disabled test suites

Open
#11,550 8 comments 0 reactions 0 assignees View on GitHub
bug tracker triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

Please leave a comment and mark on the TODO tests in this issue if you want to contribute

## Backend
VL(Velox)

## Bug Description

These suites were commented out in https://github.com/apache/incubator-gluten/pull/11512 with TODO markers(and were updated based on #11800) indicating they need to be fixed and re-enabled.

## Context

The test suites below have been disabled due to various failures. Each table shows the status for both Spark 4.0 and 4.1:
- πŸ”΄ = Suite is commented out (disabled)
- 🟒 = Suite is enabled

The failure count (when available) is shown in the status column.

---

### org.apache.spark.sql

| Suite | Spark 4.0 | Spark 4.1 | Owner | Comments |
|-------|-----------|-----------|-------|----------|
| `GlutenDataFrameSubquerySuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11727 |
| `GlutenExplainSuite` | 🟒 | 🟒 | | Disabled in #12546 |
| `GlutenJoinHintSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11816 |
| `GlutenLogQuerySuite` | 🟒 | 🟒 | @kapilks | Fixed |
| `GlutenRandomDataGeneratorSuite` | 🟒 | 🟒 | #11919 | ixed in #12533 |
| `GlutenSetCommandSuite` | 🟒 | 🟒 | Fixed in #12533 | |
| `GlutenSingleLevelAggregateHashMapSuite` | 🟒 | 🟒 | @kapilks | Fixed |
| `GlutenSparkSessionJobTaggingAndCancellationSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11847 |
| `GlutenTwoLevelAggregateHashMapSuite` | 🟒 | 🟒 | @kapilks | Fixed |
| `GlutenTwoLevelAggregateHashMapWithVectorizedMapSuite` | 🟒 | 🟒 | @kapilks | Fixed |
| `GlutenVariantEndToEndSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11726 |
| `GlutenVariantShreddingSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11726 |
| `GlutenXmlFunctionsSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11725 |
| `GlutenSparkSessionExtensionSuite` | 🟒 | 🟒 | | Fixed in #12475 |
| `GlutenTPCDSV1_4_PlanStabilitySuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11799 |
| `GlutenTPCDSV1_4_PlanStabilityWithStatsSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11799 |
| `GlutenTPCDSV2_7_PlanStabilitySuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11799 |
| `GlutenTPCDSV2_7_PlanStabilityWithStatsSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11799 |
| `GlutenTPCDSModifiedPlanStabilitySuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11799 |
| `GlutenTPCDSModifiedPlanStabilityWithStatsSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11799 |
| `GlutenTPCHPlanStabilitySuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11799 |

### catalyst.expressions

| Suite | Spark 4.0 | Spark 4.1 | Owner | Comments |
|-------|-----------|-----------|-------|----------|
| `GlutenCastWithAnsiOnSuite` | πŸ”΄ (4 failures) | πŸ”΄ (10 failures) | #10134 | ANSI + TimeType |
| `GlutenCollationRegexpExpressionsSuite` | 🟒 | πŸ”΄ (1 failure) | #11913 | Velox split limit unsupported |
| `GlutenCsvExpressionsSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11816 |
| `GlutenExpressionEvalHelperSuite` | 🟒 | 🟒 | | Disabled in #12484 |
| `GlutenObjectExpressionsSuite` | 🟒 | 🟒 | | Disabled in #12484 |
| `GlutenOrderingSuite` | 🟒 | 🟒 | #11919 | Fixed in #12484 |
| `GlutenScalaUDFSuite` | 🟒 | 🟒 | | Disabled in #12484 |
| `GlutenToPrettyStringSuite` | 🟒 | 🟒 | #11918 | Fixed in #12048 |
| `GlutenXmlExpressionsSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11580 |

### connector

| Suite | Spark 4.0 | Spark 4.1 | Owner | Comments |
|-------|-----------|-----------|-------|----------|
| `GlutenGroupBasedUpdateTableSuite` | 🟒 | 🟒 | #11912 | Fixed in #12493 |
| `GlutenMergeIntoDataFrameSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11812 |

### execution

| Suite | Spark 4.0 | Spark 4.1 | Owner | Comments |
|-------|-----------|-----------|-------|----------|
| `GlutenColumnarRulesSuite` | 🟒 | 🟒 | #11920 | Fixed in #12004 |
| `GlutenDataSourceScanExecRedactionSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11816 |
| `GlutenDataSourceV2ScanExecRedactionSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11816 |
| `GlutenExternalAppendOnlyUnsafeRowArraySuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11847 |
| `GlutenHiveResultSuite` | 🟒 | 🟒 | #11919 | Fixed in #12484 |
| `GlutenInsertSortForLimitAndOffsetSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11816 |
| `GlutenLogicalPlanTagInSparkPlanSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11833. Core fix: propagate LOGICAL_PLAN_TAG during offload |
| `GlutenMultiStatefulOperatorsSuite` | 🟒 | 🟒 | #11911 | Fixed in #11957 |
| `GlutenPlannerSuite` | 🟒 | 🟒 | | Disabled in #12512 |
| `GlutenProjectedOrderingAndPartitioningSuite` | 🟒 | 🟒 | | Disabled in #12512 |
| `GlutenRemoveRedundantProjectsSuite` | 🟒 | 🟒 | | Fixed in #12506 |
| `GlutenRemoveRedundantSortsSuite` | 🟒 | 🟒 | | Fixed in #12497 |
| `GlutenSQLExecutionSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11847 |
| `GlutenSQLJsonProtocolSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11847 |
| `GlutenShufflePartitionsUtilSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11847 |
| `GlutenSimpleSQLViewSuite` | 🟒 | 🟒 | #11912 | Fixed in #12502 |
| `GlutenSparkPlanSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11816 |
| `GlutenUnsafeRowSerializerSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11847 |
| `GlutenWholeStageCodegenSparkSubmitSuite` | 🟒 | 🟒 | | Disabled in #12512 |
| `GlutenWholeStageCodegenSuite` | 🟒 | 🟒 | | Fixed in #12507 |

### execution.joins

| Suite | Spark 4.0 | Spark 4.1 | Owner | Comments |
|-------|-----------|-----------|-------|----------|
| `GlutenSingleJoinSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11577 |

### execution.datasources.parquet

| Suite | Spark 4.0 | Spark 4.1 | Owner | Comments |
|-------|-----------|-----------|-------|----------|
| `GlutenParquetTypeWideningSuite` | 🟒 | 🟒 | @baibaichen | Fixed in #11683 |
| `GlutenParquetVariantShreddingSuite` | 🟒 | 🟒 |@baibaichen | Fixed in #11726 |

### execution.datasources.text

| Suite | Spark 4.0 | Spark 4.1 | Owner | Comments |
|-------|-----------|-----------|-------|----------|
| `GlutenWholeTextFileV1Suite` | 🟒 | 🟒 | @baibaichen | Fixed in #11816 |
| `GlutenWholeTextFileV2Suite` | 🟒 | 🟒 | @baibaichen | Fixed in #11816 |

### execution.python

| Suite | Spark 4.0 | Spark 4.1 | Owner | Comments |
|-------|-----------|-----------|-------|----------|
| `GlutenPythonDataSourceSuite` | πŸ”΄ (1 failures) | πŸ”΄ | @baibaichen | #11908 |
| `GlutenPythonUDFSuite` | πŸ”΄ (1 failures) | πŸ”΄ | @baibaichen | #11908 |
| `GlutenPythonUDTFSuite` | πŸ”΄ | πŸ”΄ | @baibaichen | #11908 |
| `GlutenRowQueueSuite` | 🟒 | πŸ”΄ | @baibaichen | #11908 |

### sources

| Suite | Spark 4.0 | Spark 4.1 | Owner | Comments |
|-------|-----------|-----------|-------|----------|
| `GlutenBucketedReadWithHiveSupportSuite` | 🟒 | 🟒 | @baibaichen | Deleted in #11847 (TestHiveSingleton conflict) |
| `GlutenBucketedWriteWithHiveSupportSuite` | 🟒 | 🟒 | @baibaichen | Deleted in #11847 (TestHiveSingleton conflict) |
| `GlutenCommitFailureTestRelationSuite` | 🟒 | 🟒 | @baibaichen | Deleted in #11847 (TestHiveSingleton conflict) |
| `GlutenDisableUnnecessaryBucketedScanWithHiveSupportSuite` | 🟒 | 🟒 | @baibaichen | Deleted in #11847 (TestHiveSingleton conflict) |
| `GlutenJsonHadoopFsRelationSuite` | 🟒 | 🟒 | @baibaichen | Deleted in #11847 (TestHiveSingleton conflict) |
| `GlutenParquetHadoopFsRelationSuite` | 🟒 | 🟒 | @baibaichen | Deleted in #11847 (TestHiveSingleton conflict) |
| `GlutenSimpleTextHadoopFsRelationSuite` | 🟒 | 🟒 | @baibaichen | Deleted in #11847 (TestHiveSingleton conflict) |

### streaming

Structured Streaming suites (20 disabled) are tracked in #11911.

---

## Summary Statistics

- **Total suites disabled in Spark 4.0**: 69
- **Total suites disabled in Spark 4.1**: 79
- **Unique suites across both versions**: 79

### PRs

| PR | Status | Suites fixed |
|----|--------|-------------|
| #11577 | βœ… Merged | 1: SingleJoinSuite |
| #11580 | βœ… Merged | 1: XmlExpressionsSuite |
| #11683 | βœ… Merged | 1: ParquetTypeWideningSuite |
| #11725 | βœ… Merged | 1: XmlFunctionsSuite |
| #11726 | βœ… Merged | 2: VariantEndToEnd, VariantShreddingSuite |
| #11727 | βœ… Merged | 1: DataFrameSubquerySuite |
| #11799 | βœ… Merged | 7: TPCDS PlanStability suites |
| #11812 | βœ… Merged | 1: MergeIntoDataFrame (JobTagging reverted in #11908) |
| #11833 | βœ… Merged | 1: LogicalPlanTagInSparkPlan (150 tests) |
| #11847 | βœ… Merged | 6 enabled + 7 deleted: SystemPropertyTrait suites |
| #11816 | βœ… Merged | 8 suites + 2 trait fix + 1 disable |
| #11908 | πŸ”΅ Draft | 4: PythonDataSource, PythonUDF, PythonUDTF, RowQueue |

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.