apache / apache/incubator-xtable

Add a timeout= option for the runSync()?

Open
#821 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
1.2k
Forks
212
Avg merge
4d 9h
Merged PRs (30d)
16

Description

### Feature Request / Improvement

It would be worth adding a **timeout** option for the main syncing function to allow the system to return back to normal to investigate the problem without entering into resource leak problem linked to the execution or a costly cloud execution without full knowledge of the required time.
It is as basically saying I expect this sync to complete in less than 30 minutes, if not than it is not worth it before some data are changed before resyncing.

This feature can be valuable especially for full-sync of large tables.

May require the use of `https://docs.oracle.com/javase/8/docs/api/java/util/concurrent/CompletableFuture.html` in _XTableSync_ class' _runSync_())

[### Are you willing to submit PR?

- [x] Yes I am willing to submit a PR!](https://github.com/apache/incubator-xtable/pull/823)

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the XTableSync.runSync() entry point and review the linked pull request 823 alongside Java's CompletableFuture documentation. Determine how the timeout should affect long-running full syncs, and verify that an expired sync returns control without leaving execution or resource leaks.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.