apache / apache/beam

Refactor KuduIO tests to use embedded Kudu

Open
#19,372 0 comments 0 reactions 0 assignees View on GitHub
improvement io java kudu P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Kudu 1.9.0 [introduces](https://kudu.apache.org/docs/release_notes.html) the ability to start an embedded cluster for testing against. Beam unit tests currently mock the Kudu server but the embedded server would be a far better test. The integration tests should continue to use Kudu in Docker.

Note that Kudu mark this as experimental but developers in Kudu will appreciate feedback if issues arise.

Imported from Jira [BEAM-6842](https://issues.apache.org/jira/browse/BEAM-6842). Original Jira may contain additional context.
Reported by: timrobertson100.

Contributor guide

Open the contributing guide

Research direction

Start with the KuduIO unit tests and compare their mocked-server setup with Kudu 1.9.0's embedded-cluster support. Keep the integration tests using Kudu in Docker, and verify that the KuduIO tests pass against the embedded cluster without mocks.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
testing-qa
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.