Add merge key to pipeline
- Dominant language
- Python
- Stars
- 5.9k
- Forks
- 600
- Avg merge
- 1d 14h
- Merged PRs (30d)
- 38
Description
### Feature description
I would like to be able to use merge key without declaring a resource. Without it, using PK alone restricts the types of merges I can do
### Are you a dlt user?
None
### Use case
_No response_
### Proposed solution
user tried to
```python
info = pipeline.run(data2,
table_name="users",
write_disposition="merge",
merge_key='ID'
)
```
### Related issues
_No response_
Contributor guide
Research direction
Start by tracing the Python pipeline.run call shown in the example and how write_disposition="merge" is handled. Done means merge_key="ID" works without declaring a resource and enables the requested merge behavior; the relevant implementation path and tests still need to be identified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100