dbt-labs / dbt-labs/dbt

[Feature] produce sdist for dbt-core v2 package

Open
#15,643 1 comment 0 reactions 2 assignees Claimed by @tauhid621 View on GitHub
area:engine engine:v1 engine:v2 type:feature
Dominant language
Rust
Stars
13.8k
Forks
2.6k
Avg merge
21h 31m
Merged PRs (30d)
56

Description

### Is this your first time submitting a feature request?

- [x] I have read the [expectations for open source contributors](https://docs.getdbt.com/docs/contributing/oss-expectations)
- [x] I have searched the existing issues, and I could not find an existing issue for this feature
- [x] I am requesting a straightforward extension of existing dbt functionality, rather than a Big Idea better suited to a discussion

### Which version of dbt is this feature for?

dbt v2.x (Core or Fusion)

### Describe the feature

In the process of updating the `conda-forge` packaging for `dbt-core` v1.12.0 https://github.com/conda-forge/dbt-feedstock/pull/171 I found that there was no source distribution available for the bundled experimental parser CLI which is alpha. I see that there are dozens of subdirectories under `crates/` so there's obviously a lot going on in there and this is probably not the highest priority, but in the fullness of time (when v2 becomes the primary version) it would be nice if source distribution for the new rustified dbt-core were available to build from scratch over there. It also seemed like the most recent alpha 2.0.0a5 wasn't really being packaged at all -- and instead that the binaries were getting downloaded at install time on the user's machine, which isn't a pattern I've seen before.

### Describe alternatives you've considered

I opened a PR to try and package and redistribute the built binaires here: https://github.com/conda-forge/staged-recipes/pull/34267 but `conda-forge` strongly discourages binary redistribution.

In the meantime, I marked the experimental CLI as an optional dependency and stripped it from the conda package, so that the production dbt-core v1.12.0 could still be distributed on conda-forge.

### Who will this benefit?

Dowstream users who use the conda ecosystem and package managers like conda, mamba, or pixi to manage their python environments, which is especially useful for finnicky scientific libraries.

### Are you interested in contributing this feature?

Unfortunately I'm not familiar with the rust toolchain. Mostly I'm a drive-by conda packager for packages I depend on.

### Anything else?

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.