Owner

smart-data-lake

5 indexed repositories · View on GitHub

smart-data-lake
Smart Automation Tool for building modern Data Lakes and Data Pipelines

Scala · 130 stars
sdl-examples
Examples for Smart Data Lake

Scala · 4 stars
sdl-visualization
Visualization for SDLB config

TypeScript · 4 stars
schema-viewer
React component for visualizing the SDLB config schema

TypeScript · 0 stars
getting-started
Code examples for the Getting Started Guide for Smart Data Lake

Shell · 0 stars

Beginner friendly Everything

Open All

Declare the foreign keys between the data objects Open

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

smart-data-lake/getting-started#52 · Opened Sep 18, 2026
Additional run information on DataObject / Action Open

smart-data-lake/sdl-visualization#133 · 1 assignee · Opened Sep 15, 2026
DataObject/Action last run links wrong Open

bug

smart-data-lake/sdl-visualization#132 · 1 assignee · Opened Sep 15, 2026
Refresh Workflow view Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

smart-data-lake/sdl-visualization#131 · Opened Sep 14, 2026
Read column descriptions from the schema, remove _columnDescriptions Open

smart-data-lake/sdl-visualization#129 · 1 assignee · Opened Sep 3, 2026
Schema Viewer Entries for options from underlying libraries Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

smart-data-lake/smart-data-lake#1120 · Opened Aug 18, 2026
Implement MCP Server Open

enhancement

smart-data-lake/smart-data-lake#1067 · 1 assignee · Opened Apr 9, 2026
Support injection of Databricks job parameters and task values into SDLB HOCON configuration Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

smart-data-lake/smart-data-lake#1059 · 1 comment · Opened Mar 16, 2026
Move dataset and TestTool to a separate module Open

enhancement

smart-data-lake/smart-data-lake#1049 · 1 assignee · Opened Feb 10, 2026
Support nullable PKs in HistorizeAction Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

smart-data-lake/smart-data-lake#1042 · Opened Jan 28, 2026
Build OpenSkyNetwork example Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

smart-data-lake/smart-data-lake#1040 · Opened Jan 22, 2026
Create a Visual Studio Code Plugin Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

smart-data-lake/sdl-visualization#123 · Opened Jan 22, 2026
Create config knowledge base Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

smart-data-lake/smart-data-lake#1033 · Opened Nov 28, 2025
Lineage Download is broken Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

smart-data-lake/sdl-visualization#120 · Opened Jul 14, 2025
HistorizeAction cannot create hash codes based on Map element types anymore Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

smart-data-lake/smart-data-lake#993 · Opened Jun 25, 2025
Add Syntax Highlighting for Code Blocks Open

enhancement

smart-data-lake/schema-viewer#29 · 1 assignee · Opened Jun 19, 2025
Use Unit Catalog? Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

smart-data-lake/getting-started#43 · Opened May 23, 2025
Default column size for workflow name is to small Open

smart-data-lake/sdl-visualization#116 · 1 assignee · Opened May 23, 2025
Issue downloading latest spark version for selected minor version Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

smart-data-lake/getting-started#37 · Opened Feb 11, 2025
Make schema converter non-strict for decimal to factorial number conversion Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 45/100

smart-data-lake/smart-data-lake#936 · Opened Dec 25, 2024
Create Snowflake Iceberg Table Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

smart-data-lake/smart-data-lake#927 · Opened Dec 18, 2024
Bad value for type BigDecimal : NaN in Postgres Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 30/100

smart-data-lake/smart-data-lake#923 · Opened Dec 13, 2024
Support for default and generated columns Open

enhancement

smart-data-lake/smart-data-lake#912 · 1 comment · 1 assignee · Opened Nov 27, 2024
Improve visualization of transformer parameters Open

good first issue

smart-data-lake/sdl-visualization#107 · 1 assignee · Opened Nov 7, 2024
RecursiveInputs not shown in Inputs Open

good first issue

smart-data-lake/sdl-visualization#106 · 1 assignee · Opened Nov 7, 2024
Implement Delta Sharing DataObject Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

smart-data-lake/smart-data-lake#905 · Opened Oct 25, 2024
PrimaryKey export in DataObjectsExporterDataObject Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

smart-data-lake/smart-data-lake#897 · Opened Oct 2, 2024
FileNotFound with FileIncrementalMoveMode and DataFrame propagation Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

smart-data-lake/smart-data-lake#892 · Opened Sep 4, 2024
Show ExecutionCondition and ExecutionMode in Action Table Open

good first issue

smart-data-lake/sdl-visualization#104 · 1 assignee · Opened Aug 27, 2024
StandardizeColNamesTransformer for nested data types Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

smart-data-lake/smart-data-lake#870 · Opened Aug 2, 2024
Read different rowTags from an XML File Open

discussion enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

smart-data-lake/smart-data-lake#869 · 1 comment · Opened Aug 2, 2024
Implement transformPartitionValues for FileTransferAction Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

smart-data-lake/smart-data-lake#868 · Opened Aug 2, 2024
Implement SQL/ELT Engine Open

enhancement

smart-data-lake/smart-data-lake#866 · 3 comments · 1 assignee · Opened Aug 2, 2024
Update Workflow Table - State Format Version 5 changed naming of SdlbVersion and AppVersion Info Open

good first issue

smart-data-lake/sdl-visualization#102 · 1 assignee · Opened Jul 15, 2024
Merge with limited partitions Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

smart-data-lake/smart-data-lake#835 · Opened May 17, 2024
Lineage view: optimize edge path Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

smart-data-lake/sdl-visualization#87 · Opened May 15, 2024
When to re-render the lineage graph Open

smart-data-lake/sdl-visualization#83 · 1 assignee · Opened Mar 21, 2024
Implement a drop-down to visualize an Attribute of a Node Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

smart-data-lake/sdl-visualization#78 · Opened Mar 13, 2024
Show Run Logs Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

smart-data-lake/sdl-visualization#71 · Opened Feb 22, 2024
Separate Releases per Spark Version Open

discussion enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

smart-data-lake/smart-data-lake#786 · Opened Jan 31, 2024
Create Maven Archetype Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

smart-data-lake/smart-data-lake#749 · 1 comment · Opened Oct 29, 2023
Column encryption algorithm Open

enhancement

smart-data-lake/smart-data-lake#722 · 1 assignee · Opened Aug 22, 2023
Support creating/managing views by a specific Action Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

smart-data-lake/smart-data-lake#702 · 1 comment · Opened Jun 30, 2023
Keyboard navigation for schema tree Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

smart-data-lake/schema-viewer#21 · Opened Jun 12, 2023
Definitions section in JSON schema is not conformant with schema specification Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

smart-data-lake/smart-data-lake#662 · Opened May 12, 2023
Data Version Control (DVC) Open

discussion enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

smart-data-lake/smart-data-lake#646 · 1 comment · Opened Apr 21, 2023
Alternative to temporary tables in JdbcTableDataObject Open

enhancement

smart-data-lake/smart-data-lake#636 · 1 comment · 1 assignee · Opened Mar 16, 2023
KMS for encrypted parquet files Open

enhancement

smart-data-lake/smart-data-lake#586 · 1 assignee · Opened Nov 2, 2022
Glossary Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

smart-data-lake/sdl-visualization#16 · Opened Sep 9, 2022
Searching Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

smart-data-lake/sdl-visualization#15 · 1 comment · Opened Sep 7, 2022

smart-data-lake

Get new issues in your inbox