dlt-hub / dlt-hub/dlt

refine how workspace run context reports on profiles

Open
#3,395 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.9k
Forks
605
Avg merge
1d 14h
Merged PRs (30d)
38

Description

We need one more list of profiles that correspond to those that are actually present in workspace. Right now we are listing all pre-defined profiles + the one that is pinned.

1. make config providers to list configured profiles (by inspecting the files that got found)
2. make workspace to scan `.var` to find our profiles that were used to actually run pipelines (for standard layout)
3. make workspace dashboard to show configured profiles instead of available ones.

Contributor guide

Open the contributing guide

Research direction

Start by tracing the config providers, workspace, and workspace dashboard components named in the issue. Inspect the files found by the providers and the standard-layout .var directory to understand configured and used profiles. Done means the dashboard lists configured profiles that are actually present or used, rather than all predefined profiles plus the pinned profile.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering, developer-experience
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.