apache / apache/hudi-rs

Add test cases for tables with async table services and multi-writer scenarios

Open
#392 0 comments 0 reactions 0 assignees View on GitHub
test
Dominant language
Rust
Stars
279
Forks
67
Avg merge
3d 1h
Merged PRs (30d)
40

Description

Add test fixtures (zipped hudi tables v6 and v8) to `crates/test/`. The test tables should cover

- COW + async clustering
- MOR + async clustering / compaction
- COW + multi-writer
- MOR + multi-writer

The test tables only need to contain timeline files. The tests can verify the right commits are read and the intended list of data files are returned by the timeline.

Contributor guide

Open the contributing guide

Research direction

Start in crates/test/ and review how timeline-focused table fixtures and tests are organized. Add zipped Hudi table fixtures covering COW and MOR with async clustering, compaction, and multi-writer scenarios; done means tests verify the expected commits and intended data-file lists from the timeline.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
databases, testing
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.