apache / apache/gluten

[VL] List Spark-3.2 UTs failed when upgrading arrow to 15.0.0

Open
#5,538 0 comments 0 reactions 1 assignee Claimed by @philo-he View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Description

See https://github.com/apache/incubator-gluten/pull/5174 that upgrades arrow. The below UTs are ignored in that pr.

- SPARK-23786: warning should be printed if CSV header doesn't conform to schema *** FAILED ***
testAppender1.loggingEvents.exists(((msg: org.apache.log4j.spi.LoggingEvent) => msg.getRenderedMessage().contains("CSV header does not conform to the schema"))) was false (CSVSuite.scala:1785)
- SPARK-23786: warning should be printed if CSV header doesn't conform to schema *** FAILED ***
testAppender1.loggingEvents.exists(((msg: org.apache.log4j.spi.LoggingEvent) => msg.getRenderedMessage().contains("CSV header does not conform to the schema"))) was false (CSVSuite.scala:1785)
- SPARK-33933: Materialize BroadcastQueryStage first in AQE *** FAILED ***
java.lang.ArrayIndexOutOfBoundsException: 0
at org.apache.spark.sql.execution.adaptive.AdaptiveQueryExecSuite.$anonfun$new$172(AdaptiveQueryExecSuite.scala:1695)
at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83)
at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
at org.scalatest.Transformer.apply(Transformer.scala:22)
at org.scalatest.Transformer.apply(Transformer.scala:20)
at org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:190)
at org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:190)
at org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:188)
at org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:200)
...
- Gluten - Logging plan changes for AQE *** FAILED ***
testAppender.loggingEvents.exists(((x$23: org.apache.log4j.spi.LoggingEvent) => x$23.getRenderedMessage().contains(expectedMsg))) was false (VeloxAdaptiveQueryExecSuite.scala:839)
- Gluten - test log level *** FAILED ***
logAppender.loggingEvents.exists(((event: org.apache.log4j.spi.LoggingEvent) => event.getRenderedMessage().contains(msg).&&(event.getLevel().==(expectedLevel)))) was false (VeloxAdaptiveQueryExecSuite.scala:1471)
- Resolve join hint in CTE *** FAILED ***
ArrayBuffer() had size 0 instead of expected size 2 (CTEHintSuite.scala:70)
- SPARK-23786: warning should be printed if CSV header doesn't conform to schema *** FAILED ***
testAppender1.loggingEvents.exists(((msg: org.apache.log4j.spi.LoggingEvent) => msg.getRenderedMessage().contains("CSV header does not conform to the schema"))) was false (CSVSuite.scala:1785)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.