apache / apache/hudi

Add bundle validation for hive sync bundle and hadoop mr bundle

Open
#17,971 0 comments 0 reactions 0 assignees View on GitHub
type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

### Task Description

**What needs to be done:**
We need to add bundle validation for hive sync bundle and hadoop-mr bundle

The validation has to be done in an environment without Spark dependencies

**Why this task is needed:**

This can ensure users don't run into Spark dependency issues when they are only using hive sync/hadoop-mr bundle

### Task Type

Code improvement/refactoring

### Related Issues

**Parent feature issue:** (if applicable )
**Related issues:**
NOTE: Use `Relationships` button to add parent/blocking issues after issue is created.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are named in the issue. Locate the hive sync and hadoop-mr bundle validation entry points and the dependency setup for an environment without Spark; done means both bundles validate without introducing Spark dependency issues.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
build-system
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.