dlt-hub/dlt

View on GitHub

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Stars: 5.9k
Forks: 600
Open beginner issues: 0
Indexed issues: 319
Avg merge: 1d 15h
Merged PRs (30d): 38

Dominant language: Python
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 15, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue help wanted

Open All

319 open issues indexed

[core] customize pipeline with hooks Open

dlt-hub/dlt#63 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
implement include and exclude filters in Schema as data item transformations Open

good first issue

dlt-hub/dlt#64 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
when yielding data from a resource, mark given value to be normalized Open

dlt-hub/dlt#153 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
remove the OS filename length restriction impacting the identifiers length Open

bug

dlt-hub/dlt#191 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
add hints and columns propagation for nested table (ie. partition column propagation) Open

tech-debt

dlt-hub/dlt#242 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
recognize uris as data locations in pipeline.run method and auto use core sources Open

enhancement QoL

dlt-hub/dlt#338 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Support generic types in config fields Open

dlt-hub/dlt#465 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Feature request: support for Yaml column renaming Open

dlt-hub/dlt#585 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Automatically convert inconsistent data types Open

dlt-hub/dlt#715 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
improve destination fingerprinting and info Open

tech-debt

dlt-hub/dlt#751 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
make the use of `loader_file_format` parameter consistent Open

good first issue QoL

dlt-hub/dlt#815 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
use source scoped configs for all pipeline steps Open

dlt-hub/dlt#816 · 0 comments · 2 reactions · 0 assignees · Indexed Sep 15, 2026
use pydata_google_auth in GcpCredentials Open

credentials

dlt-hub/dlt#943 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Allow to backup and restore pipeline working directory Open

enhancement

dlt-hub/dlt#944 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
document best security practices for dependencies when installing dlt Open

dlt-hub/dlt#957 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
allow to define certain destination capabilities via configuration Open

community

dlt-hub/dlt#964 · 6 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Add merge key to pipeline Open

QoL

dlt-hub/dlt#968 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
HDFS as a destination Open

community destination

dlt-hub/dlt#986 · 1 comment · 3 reactions · 0 assignees · Indexed Sep 15, 2026
Enable dlt to run on managed AWS airflow MWAA Open

bug community

dlt-hub/dlt#995 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Simplify schema management - Specifying `preferred_types` without full schema definitions Open

community QoL

dlt-hub/dlt#1015 · 1 comment · 4 reactions · 0 assignees · Indexed Sep 15, 2026
key-only delete records don't work with non-nullable columns Open

bug

dlt-hub/dlt#1066 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Even more custom Destination follow up work Open

tech-debt

dlt-hub/dlt#1091 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Support of Geometry type / spatial data Open

dlt-hub/dlt#1101 · 0 comments · 2 reactions · 0 assignees · Indexed Sep 15, 2026
allow destinations to consume iterators directly ie. via pipe operator Open

dlt-hub/dlt#1133 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Add support for dropping column in destination & dlt schema Open

community QoL

dlt-hub/dlt#1153 · 1 comment · 1 reaction · 1 assignee · Indexed Sep 15, 2026
improve Dremio destination Open

destination enhancement

dlt-hub/dlt#1199 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
annotate Pydantic models with dlt hints Open

community enhancement

dlt-hub/dlt#1221 · 0 comments · 3 reactions · 0 assignees · Indexed Sep 15, 2026
Support state synching to separate destination / Catalogue Open

enhancement

dlt-hub/dlt#1233 · 1 comment · 4 reactions · 0 assignees · Indexed Sep 15, 2026
`scd2` merge strategy extensions Open

enhancement

dlt-hub/dlt#1252 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Normaliser mode: more ways to unnest data where max table nesting does not suffice Open

QoL

dlt-hub/dlt#1303 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
pyarrow/pandas: add load id and dlt id in the extract phase and unify the behavior Open

tech-debt

dlt-hub/dlt#1317 · 0 comments · 5 reactions · 1 assignee · Indexed Sep 15, 2026
allow resources with many pipes (ie. partitioned resources) Open

dlt-hub/dlt#1319 · 0 comments · 2 reactions · 0 assignees · Indexed Sep 15, 2026
[WIP] allow to fork and split pipelines Open

enhancement

dlt-hub/dlt#1433 · 1 comment · 1 reaction · 1 assignee · Indexed Sep 15, 2026
airlfow helper does not clean pipeline working folder when DAG is created Open

bug

dlt-hub/dlt#1464 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
allow to import external files into pipeline extract storage and load them directly Open

dlt-hub/dlt#1471 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
`create-a-pipeline` walkthrough inaccuracies Open

documentation

dlt-hub/dlt#1521 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
document global envinroment settings Open

documentation

dlt-hub/dlt#1546 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
RESTClient: improve paginator tests and docs Open

dlt-hub/dlt#1552 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
support nested types for arrow / parquet Open

dlt-hub/dlt#1592 · 1 comment · 5 reactions · 0 assignees · Indexed Sep 15, 2026
use msgspec for json serialization/deserialization and to replace typed-json with msgpack Open

dlt-hub/dlt#1604 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Add support for sdc2 strategy in source pg_replication Open

community

dlt-hub/dlt#1607 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Filesystem destination does not respect preferred_loader_file_format for dlt metadata Open

bug community

dlt-hub/dlt#1631 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Extend `upsert` support to remaining SQL destinations Open

enhancement

dlt-hub/dlt#1648 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
remove click Open

good first issue

dlt-hub/dlt#1658 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Enforce no whitespace in pipeline names to avoid potential issues Open

enhancement

dlt-hub/dlt#1667 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
support staging for duckdb and motherduck Open

dlt-hub/dlt#1692 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[ci] move private test github deployment key from code to CI Open

tech-debt

dlt-hub/dlt#1701 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
support loading via staging for postgres with embedded duckdb (pg_duckdb) Open

dlt-hub/dlt#1715 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
`scd2` validity column values based on column in source data Open

enhancement

dlt-hub/dlt#1776 · 0 comments · 4 reactions · 0 assignees · Indexed Sep 15, 2026
Proper pipeline `refresh` with `delta` table format Open

enhancement

dlt-hub/dlt#1777 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

dlt-hub/dlt

Get new issues in your inbox