aws-samples / aws-samples/dbt-glue
dbt glue not supported for openlineage events
- Dominant language
- Python
- Stars
- 147
- Forks
- 96
- Avg merge
- 7h 4m
- Merged PRs (30d)
- 5
Description
when running dbt-ol on models running on dbt-glue adaptor it gives an error saying
NotImplementedError: Only `bigquery`,`snowflake`,`redshift`,`spark`,`postgres`,`databricks`,`sqlserver`,`dremio`,`athena` adapters are supported right now. Passed glue
Is there any workaround for this?
Contributor guide
Research direction
Start with the dbt-glue adapter and the dbt-ol integration point that produces the reported NotImplementedError. Trace where the supported adapter list is enforced and determine the requirements for handling Glue. Done means dbt models using the Glue adapter can produce OpenLineage events without this error; the issue names no files or tests to run.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, python
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100