apache / apache/hudi

[SUPPORT] OCC experimental ?

Open
#11,839 2 comments 0 reactions 0 assignees View on GitHub
area:concurrency docs
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

[SUPPORT] in https://hudi.apache.org/docs/concurrency_control its written ```Please note that this feature is currently experimental and requires external lock providers to acquire locks briefly at critical sections during the write. More on lock providers below. ```
is this general for OCC or is it experimental for internal lock providers ??
i have a requirement to run multiple jobs majorly for deleting older partitions over the continuous stream ingestion, can i use dynamo db as a locking mechanism and enable OCC ?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the concurrency control documentation at https://hudi.apache.org/docs/concurrency_control, focusing on the OCC and lock-provider sections. Clarify whether the experimental status applies to OCC generally or only internal lock providers, and document whether DynamoDB can serve the requested locking use case.

Written by the indexing model from the issue text.

Assessment

Domain
distributed-systems, stream-processing
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.