ISISNeutronMuon / ISISNeutronMuon/analytics-data-platform

Track release of dbt v2

Open
#369 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
0
Forks
0
Avg merge
2d 7h
Merged PRs (30d)
21

Description

At the time of writing dbt has an alpha version of `dbt v2`. It has a core rewritten in rust and is the future direction of travel for the project: https://docs.getdbt.com/blog/dbt-core-v2-is-here?version=2.0&name=Fusion.

A quick test locally of the pre-release version shows some issues:

`dbt deps`:

```bash
dbt-fusion 2.0.0-preview.192
Finished [ 0.13s] resolving packages from packages.yml (3 items)
Installed starburstdata/trino_utils: 0.6.0
Installed dbt-labs/codegen: 0.14.0
Installed dbt-labs/dbt_utils: 1.3.3
Installed 3 packages
Updated version available for codegen@0.14.0: 0.14.1
Updated version available for dbt_utils@1.3.3: 1.4.0

============================= Errors and Warnings ==============================
[warning] [PackageVersionMismatch (dbt1080)]: Package 'trino_utils' may not be compatible with your dbt version: Required dbt version does not match current version. Check Package Hub (https://hub.getdbt.com) for compatible versions or contact the package maintainer.

============================== Execution Summary ===============================
Finished 'deps' with 1 warning [4.3s]
```

`dbt build`:

```bash
[error] [InvalidConfig (dbt1005)]: The 'trino' adapter is not yet supported by dbt Fusion. Supported adapters: snowflake, bigquery, databricks, redshift
```

The current advice is "to migrate is to first [upgrade to dbt v1.12](https://docs.getdbt.com/docs/dbt-versions/core-upgrade/upgrading-to-v1.12). It enforces many of the behavior changes that are fully removed in v2.0 of the framework, and even ships with the Fusion-powered project parser so that you can check whether your project will parse correctly. Run dbt parse --use-v2-parser to try it out."

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked dbt v2 announcement and the v1.12 migration guidance, then reproduce the reported dbt deps warning and dbt build adapter error using the commands in the issue. Done means tracking dbt v2 release readiness and documenting the project's compatibility status once the relevant support is available.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
data-engineering, release
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.