apache / apache/datafusion-ballista

Client side may fail to get job status after invoking execute_query()

Open
#263 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Rust
Stars
2.1k
Forks
320
Avg merge
1d 22h
Merged PRs (30d)
66

Description

**Describe the bug**

Due to #134, at the scheduler side, we can not ensure that the execution graph created or there's a job info persisted to the backend after the execute_query returned. Then there's a chance that the client fails to get job status.

**To Reproduce**

**Expected behavior**

**Additional context**

Contributor guide

Open the contributing guide

Research direction

Start by tracing the client-side execute_query() flow alongside the scheduler path described in issue #134, focusing on when the execution graph and job information are persisted to the backend. Reproduce the timing race and verify that the client can reliably retrieve job status after execute_query() returns.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.