dlt-hub / dlt-hub/dlt

Add merge key to pipeline

Open
#968 0 comments 0 reactions 0 assignees View on GitHub
QoL
Dominant language
Python
Stars
5.9k
Forks
600
Avg merge
1d 14h
Merged PRs (30d)
38

Description

### Feature description

I would like to be able to use merge key without declaring a resource. Without it, using PK alone restricts the types of merges I can do

### Are you a dlt user?

None

### Use case

_No response_

### Proposed solution

user tried to
```python
info = pipeline.run(data2,
table_name="users",
write_disposition="merge",
merge_key='ID'
)
```

### Related issues

_No response_

Contributor guide

Open the contributing guide

Research direction

Start by tracing the Python pipeline.run call shown in the example and how write_disposition="merge" is handled. Done means merge_key="ID" works without declaring a resource and enables the requested merge behavior; the relevant implementation path and tests still need to be identified.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.