utilities bundle missing hive dependency
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
built bundle jar using
mvn clean package -DskipTests -Dspark3.1 -Dscala-2.12 -Putilities-bundle-shade-hive
having dependency issue
{code:java}
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat
at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 74 more{code}
adding hive-exec resolved it.
Dependency list need some fix for utilities-bundle and utilities-slim-bundle
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7321
- Type: Bug
- Affects version(s):
- 0.14.1
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the Maven command and the utilities-bundle-shade-hive profile, then inspect the dependency configuration for utilities-bundle and utilities-slim-bundle. Reproduce the missing org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat error and compare the result after adding the required Hive dependency. Done means both bundles include the dependency and load the missing class successfully.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark
- Domain
- build-system
- Issue type
- Bug
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 72/100