apache / apache/incubator-xtable

Add Iceberg concurrent-writers unit and IT tests

Open
#134 0 comments 0 reactions 1 assignee Claimed by @ashvina View on GitHub
Dominant language
Java
Stars
1.2k
Forks
212
Avg merge
4d 9h
Merged PRs (30d)
16

Description

At this point, I do not know of any scenario which may require "in-flight" checks for Iceberg. The commit time (end of transaction) seems to be creating write serializability. A failed writer, in case of version conflict with concurrent writers, retries by "rebasing" on the successful writer's commit. I can add a few concurrency tests to validate this and document the concurrency scenarios which should work with OneTable.

_Originally posted by @ashvina in https://github.com/onetable-io/onetable/pull/129#discussion_r1374981369_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.