Fix Testcase not run on windows system for SparkSQL TestCase
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
when hudi sparksql case TestCDCForSparkSQL on windows system, it would report：
Can not create a Path from an empty string
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:163)
at org.apache.hadoop.fs.Path.(Path.java:232)
at org.apache.hadoop.fs.Path.getParent(Path.java:431)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirsWithOptionalPermission(RawLocalFileSystem.java:540)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:527)
at org.apache.hadoop.fs.ChecksumFileSystem.mkdirs(ChecksumFileSystem.java:695)
at org.apache.hudi.common.table.HoodieTableMetaClient.initTableAndGetMetaClient(HoodieTableMetaClient.java:478)
at org.apache.hudi.common.table.HoodieTableMetaClient$PropertyBuilder.initTable(HoodieTableMetaClient.java:1199)
at org.apache.spark.sql.catalyst.catalog.HoodieCatalogTable.initHoodieTable(HoodieCatalogTable.scala:210)
at org.apache.spark.sql.hudi.command.CreateHoodieTableCommand.run(CreateHoodieTableCommand.scala:71)
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-6171
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-1297
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the TestCDCForSparkSQL testcase and trace the reported failure through HoodieTableMetaClient, HoodieCatalogTable, and CreateHoodieTableCommand. Reproduce it on Windows, then verify that the SparkSQL testcase completes without the empty-path IllegalArgumentException.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- hadoop, java, spark
- Domain
- data-engineering, testing
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100