[VL] List Spark-3.2 UTs failed when upgrading arrow to 15.0.0
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
### Description
See https://github.com/apache/incubator-gluten/pull/5174 that upgrades arrow. The below UTs are ignored in that pr.
- SPARK-23786: warning should be printed if CSV header doesn't conform to schema *** FAILED ***
testAppender1.loggingEvents.exists(((msg: org.apache.log4j.spi.LoggingEvent) => msg.getRenderedMessage().contains("CSV header does not conform to the schema"))) was false (CSVSuite.scala:1785)
- SPARK-23786: warning should be printed if CSV header doesn't conform to schema *** FAILED ***
testAppender1.loggingEvents.exists(((msg: org.apache.log4j.spi.LoggingEvent) => msg.getRenderedMessage().contains("CSV header does not conform to the schema"))) was false (CSVSuite.scala:1785)
- SPARK-33933: Materialize BroadcastQueryStage first in AQE *** FAILED ***
java.lang.ArrayIndexOutOfBoundsException: 0
at org.apache.spark.sql.execution.adaptive.AdaptiveQueryExecSuite.$anonfun$new$172(AdaptiveQueryExecSuite.scala:1695)
at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83)
at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
at org.scalatest.Transformer.apply(Transformer.scala:22)
at org.scalatest.Transformer.apply(Transformer.scala:20)
at org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:190)
at org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:190)
at org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:188)
at org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:200)
...
- Gluten - Logging plan changes for AQE *** FAILED ***
testAppender.loggingEvents.exists(((x$23: org.apache.log4j.spi.LoggingEvent) => x$23.getRenderedMessage().contains(expectedMsg))) was false (VeloxAdaptiveQueryExecSuite.scala:839)
- Gluten - test log level *** FAILED ***
logAppender.loggingEvents.exists(((event: org.apache.log4j.spi.LoggingEvent) => event.getRenderedMessage().contains(msg).&&(event.getLevel().==(expectedLevel)))) was false (VeloxAdaptiveQueryExecSuite.scala:1471)
- Resolve join hint in CTE *** FAILED ***
ArrayBuffer() had size 0 instead of expected size 2 (CTEHintSuite.scala:70)
- SPARK-23786: warning should be printed if CSV header doesn't conform to schema *** FAILED ***
testAppender1.loggingEvents.exists(((msg: org.apache.log4j.spi.LoggingEvent) => msg.getRenderedMessage().contains("CSV header does not conform to the schema"))) was false (CSVSuite.scala:1785)
Contributor guide
Assessment
This issue has not been assessed yet.