dlt-hub / dlt-hub/dlt

feat: `dev_mode` overhaul to use Profile feature

Open
#3,983 1 comment 0 reactions 1 assignee Claimed by @rudolfix View on GitHub
enhancement needs design QoL
Dominant language
Python
Stars
5.9k
Forks
600
Avg merge
1d 14h
Merged PRs (30d)
38

Description

When building with `dlt`, I spend a sizeable amount of time deleting `.dlt/data/dev/DATASET_NAME.duckdb` and `.dlt/state/dev/PIPELINE_NAME` manually. I want to wipe everything related to the pipeline and dataset between each execution.

Current solutions like `drop=...` are unintuitive. I never know what exactly is dropped. `dev_mode` has known issues when exiting dev_mode and it breaks the dltHub Dashboard and `dlt.Dataset` interface.

I want a simple CLI, flag or util that just deletes physical files and allows me to rerun stuff confidently without state pollution

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.