apache / apache/hudi

Enhance TransactionManager to support multi-table transaction

Open
#16,198 0 comments 0 reactions 1 assignee Assigned to @nsivabalan View on GitHub
from-jira priority:high type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Transaction Manager should be database timeline-aware and return a transaction instance when a transaction is started, which can be used with dataframe writes as below.
{code:java}
val transaction = HoodieTransactionManager.beginTransaction()
df1.write.format("hudi").withTransaction(transaction).options(opts1).save(basePath1)
df2.write.format("hudi").withTransaction(transaction).options(opts2).save(basePath2)
// All success, go ahead and commit or finish rollback (ROLLED_BACK state on timeline is written in that case)
transaction.commit() {code}
 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6748
- Type: Task
- Epic: https://issues.apache.org/jira/browse/HUDI-6709
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.