Revisit Disabled Tests in TestHiveIncrementalPuller.testPuller
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Within the pr (Support Hadoop 3.x Hive 3.x and Spark 3.x) [https://github.com/apache/hudi/pull/5786,|https://github.com/apache/hudi/pull/5786]
The test below was disabled due to a conflict with Hive's avro, since the default version for avro now will be what spark uses `1.10.2` where as hive currently uses avro 1.8.2 https://github.com/apache/hive/blob/master/pom.xml#L105
```
@Disabled("Disable due to hive not support avro 1.10.2.")
@Test
public void testPuller() throws IOException, URISyntaxException
```
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-4230
- Type: Task
Contributor guide
No contributing guide indexed for this repository
Research direction
Search for TestHiveIncrementalPuller.testPuller and inspect the disabled test and its surrounding dependency setup. Check the Hive and Spark Avro-version conflict described in the issue and run the test after addressing compatibility; done means testPuller is enabled and passes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark
- Domain
- data-engineering, stream-processing
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100