apache / apache/hudi

Add Incremental scan support to dbt

Open
#16,120 0 comments 0 reactions 1 assignee Claimed by @nsivabalan View on GitHub
area:connectors from-jira priority:high type:epic
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

The current dbt support adds only the basic hudi primitives, but with deeper integration we could enable faster ETL queries using the incremental read primitive similar to the deltastreamer support.

 

The goal of this epic is to enable incremental data processing for dbt.

 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6586
- Type: Epic
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.