aws-samples / aws-samples/dbt-glue

dbt glue not supported for openlineage events

Open
#490 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
147
Forks
96
Avg merge
7h 4m
Merged PRs (30d)
5

Description

when running dbt-ol on models running on dbt-glue adaptor it gives an error saying
NotImplementedError: Only `bigquery`,`snowflake`,`redshift`,`spark`,`postgres`,`databricks`,`sqlserver`,`dremio`,`athena` adapters are supported right now. Passed glue
Is there any workaround for this?

Contributor guide

Open the contributing guide

Research direction

Start with the dbt-glue adapter and the dbt-ol integration point that produces the reported NotImplementedError. Trace where the supported adapter list is enforced and determine the requirements for handling Glue. Done means dbt models using the Glue adapter can produce OpenLineage events without this error; the issue names no files or tests to run.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.