feat: `dev_mode` overhaul to use Profile feature
Open
enhancement
needs design
QoL
- Dominant language
- Python
- Stars
- 5.9k
- Forks
- 600
- Avg merge
- 1d 14h
- Merged PRs (30d)
- 38
Description
When building with `dlt`, I spend a sizeable amount of time deleting `.dlt/data/dev/DATASET_NAME.duckdb` and `.dlt/state/dev/PIPELINE_NAME` manually. I want to wipe everything related to the pipeline and dataset between each execution.
Current solutions like `drop=...` are unintuitive. I never know what exactly is dropped. `dev_mode` has known issues when exiting dev_mode and it breaks the dltHub Dashboard and `dlt.Dataset` interface.
I want a simple CLI, flag or util that just deletes physical files and allows me to rerun stuff confidently without state pollution
Contributor guide
Assessment
This issue has not been assessed yet.