AbsaOSS / AbsaOSS/spline-spark-agent
spark-3.5-spline-agent not working with Glue 5.0 spark 3.5
Ouverte
- Langage dominant
- Scala
- Étoiles
- 210
- Forks
- 102
- Merge moyen
- 1 j 1 h
- PR mergées (30 j)
- 1
Description
Hi,
I tried using **Spark-3.5-spline-agent-bundle_2.12-2.2.1.jar** with **AWS Glue 5.0,** but encountered an error: **IllegalArgumentException: Error while instantiating 'org.apache.spark.sql.hive.HiveSessionStateBuilder'**.
However, when I use the following options:
**Key: --java-options
Value: --add-opens=java.base/sun.net.www.protocol.jar=ALL-UNNAMED**
the job runs successfully, though the runtime increases by **approximately 1.5 minutes.**
Is there an alternative solution to resolve this issue?
Guide de contribution
Aucun guide de contribution indexé pour ce dépôt
Évaluation
Cette issue n'a pas encore été évaluée.