apache / apache/incubator-xtable

Add a flag to warn and continue sync if deletion files are not supported in the Target

Open
#657 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
1.2k
Forks
212
Avg merge
4d 9h
Merged PRs (30d)
16

Description

In my opinion, a warning log doesn't really fix the data inconsistency issue. However, I agree that adding a flag could be a good idea in the short term. I would suggest that the flag's default behavior should be to throw an error. We should also consider phasing it out in future releases.

_Originally posted by @ashvina in https://github.com/apache/incubator-xtable/pull/634#discussion_r1953894471_

Contributor guide

No contributing guide indexed for this repository

Research direction

No source file, test, or entry point is named in the issue. Begin by locating the sync path that handles deletion files unsupported by the Target and reviewing existing configuration flags; done means the behavior is configurable, defaults to throwing an error, and has coverage for warning-and-continuing.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.