dbt-labs / dbt-labs/spark-utils

More possible macros to add

Open
#5 8 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
36
Forks
14
PR merge metrics
No merged PRs in 30d

Description

for cross db compatibility and making packages easier to use:
* `ceiling` - `ceiling` in spark but `ceil` in snowflake
* `list_agg`/`string_agg` is `concat_ws({{ delimiter }}, collect_list({{ field_to_agg }})`

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the existing macro definitions and tests for cross-database functions, then inspect how this package exposes Spark utility macros. Done means adding the requested ceiling and list/string aggregation macros with the stated function mappings and coverage for their expected inputs.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, spark, sql
Domain
data-engineering, databases
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.