dbt-labs / dbt-labs/dbt-external-tables

Snowflake Stage Creation

Open
#301 2 comments 1 reaction 0 assignees View on GitHub
enhancement Stale triage
Dominant language
Jupyter Notebook
Stars
384
Forks
150
Avg merge
1h 25m
Merged PRs (30d)
1

Description

### Describe the feature
We'd like the ability to (optionally) create [snowflake stages](https://docs.snowflake.com/en/sql-reference/sql/create-stage) as a part of the dbt-external-tables package. Ideally, we'd specify in yml the specifics about the stage, and then be able to call the stage creation as an argument in the stage_external_sources macro.

### Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Other solutions within dbt are to add the stage creation code as a macro or within an on-run-start hook. While this may accomplish the same end result, it would be ideal to specify the stage right alongside the external tables so that the logic is not de-coupled.

### Additional context
Is this feature database-specific? Which database(s) is/are relevant? Please include any other relevant context here.

As far as I know, Stage creation is specific to the Snowflake external tables.

### Who will this benefit?
What kind of use case will this feature be useful for? Please be specific and provide examples, this will help us prioritize properly.

This will benefit all teams who are using snowflake external tables, as the stage creation is the first step in order to create external tables. Storing this as code within your repo allows it to be managed and version controlled alongside your external tables.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.