[Bug] hive test `testReadExternalTableNoPartitionAppendOnly` failure in JDK 11
- Dominant language
- Java
- Stars
- 3.4k
- Forks
- 1.4k
- Avg merge
- 1d 11h
- Merged PRs (30d)
- 396
Description
see https://github.com/apache/paimon/actions/runs/12042717252/job/33576853654
```
Error: Errors:
Error: HiveOnTezReadITCase>HiveReadITCaseBase.testReadExternalTableNoPartitionAppendOnly:360 » IllegalArgument
Error: HiveOnTezReadITCase>HiveReadITCaseBase.testReadExternalTableNoPartitionWithPk:136 » IllegalArgument
Error: HiveOnTezReadITCase>HiveReadITCaseBase.testReadExternalTableWithPartitionAppendOnly:436 » IllegalArgument
Error: HiveOnTezReadITCase>HiveReadITCaseBase.testReadExternalTableWithPartitionWithPk:259 » IllegalArgument
```
```
Error: org.apache.paimon.hive.HiveOnTezReadITCase.testReadExternalTableWithPartitionWithPk Time elapsed: 1.715 s <<< ERROR!
java.lang.IllegalArgumentException: Failed to executeQuery Hive query SELECT * FROM test_table_3dca ORDER BY pt, a: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Uncaught Exception when handling event DAG_START on Dag dag_1732676143388_0001_1 at currentState=INITED
at com.klarna.hiverunner.HiveServerContainer.executeStatement(HiveServerContainer.java:143)
at com.klarna.hiverunner.builder.HiveShellBase.executeStatementsWithCommandShellEmulation(HiveShellBase.java:121)
at com.klarna.hiverunner.builder.HiveShellBase.executeStatementWithCommandShellEmulation(HiveShellBase.java:115)
at com.klarna.hiverunner.builder.HiveShellBase.executeStatement(HiveShellBase.java:105)
at com.klarna.hiverunner.builder.HiveShellBase.executeQuery(HiveShellBase.java:94)
at com.klarna.hiverunner.builder.HiveShellBase.executeQuery(HiveShellBase.java:87)
at org.apache.paimon.hive.HiveReadITCaseBase.testReadExternalTableWithPartitionWithPk(HiveReadITCaseBase.java:259)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.apache.paimon.hive.runner.PaimonEmbeddedHiveRunner.runTestMethod(PaimonEmbeddedHiveRunner.java:153)
at org.apache.paimon.hive.runner.PaimonEmbeddedHiveRunner.runChild(PaimonEmbeddedHiveRunner.java:141)
at org.apache.paimon.hive.runner.PaimonEmbeddedHiveRunner.runChild(PaimonEmbeddedHiveRunner.java:74)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42)
at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80)
at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72)
at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:107)
at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88)
at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54)
at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67)
at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52)
at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:114)
at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:86)
at org.junit.platform.launcher.core.DefaultLauncherSession$DelegatingLauncher.execute(DefaultLauncherSession.java:86)
at org.junit.platform.launcher.core.SessionPerRequestLauncher.execute(SessionPerRequestLauncher.java:53)
at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:188)
at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:154)
at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:124)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:428)
at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162)
at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:562)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:548)
Caused by: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Uncaught Exception when handling event DAG_START on Dag dag_1732676143388_0001_1 at currentState=INITED
at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:380)
at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:257)
at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:293)
at org.apache.hive.service.cli.operation.Operation.run(Operation.java:320)
at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:530)
at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(HiveSessionImpl.java:500)
at org.apache.hive.service.cli.CLIService.executeStatement(CLIService.java:265)
at com.klarna.hiverunner.HiveServerContainer.executeStatement(HiveServerContainer.java:116)
... 54 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Uncaught Exception when handling event DAG_START on Dag dag_1732676143388_0001_1 at currentState=INITED
at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:196)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:199)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2183)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1839)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1526)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1232)
at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:255)
... 60 more
```
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the linked GitHub Actions run and the failing methods in HiveReadITCaseBase at lines 136, 259, 360, and 436. Reproduce the Hive-on-Tez failures on JDK 11, identify the cause of the DAG_START error, and verify that all four external-table tests pass.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 28/100