apache / apache/datafusion-ballista

Improve integration tests to test push scheduler mode as well

Open
#1,463 9 comments 0 reactions 0 assignees View on GitHub
enhancement good first issue help wanted
Dominant language
Rust
Stars
2.1k
Forks
320
Avg merge
1d 22h
Merged PRs (30d)
66

Description

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**

At the moment, integration tests, setup cluster in `pull mode`

- https://github.com/apache/datafusion-ballista/blob/0396c58aa58a546395fa59bf6658e17c621c0cc3/ballista/client/tests/common/mod.rs#L104

as we make `push` scheduling default in https://github.com/apache/datafusion-ballista/pull/1461 we need to improve test to cover `push` scheduling.

**Describe the solution you'd like**

create new test setup which would start cluster using `push` scheduling and include it in the tests, preferably adding additional case to each test

**Describe alternatives you've considered**

**Additional context**

Contributor guide

Open the contributing guide

Research direction

Start with ballista/client/tests/common/mod.rs around the cluster setup at the referenced line, then inspect the existing integration tests that use it. Add a push-scheduling cluster setup and include push-mode cases alongside the current pull-mode coverage. Done means the integration test suite exercises both scheduler modes successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
distributed-systems, testing
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
64/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.