fivetran / fivetran/dbt_salesforce_formula_utils

[Bug] Some Salesforce objects are missing fields when built using the DBT formula field utility

Open
#103 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

type:wontfix
Dominant language
Shell
Stars
18
Forks
21
Avg merge
15d 20h
Merged PRs (30d)
2

Description

Is there an existing issue for this?
  • I have searched the existing issues
Describe the issue

The dbt formula field utility and by extension the query model provided in the fivetran_formula_model table is missing some field on particular objects. For example on our object "account" there are 30-50 fields which exist on the raw account table coming from fivetran, but the fields are not present in the query provided in the fivetran_formula_model table for account. There doesn't seem to be anything different about these fields, many are not even formula fields. The fields are not showing in the failure reason table at all.

Relevant error log or model output
Some examples of fields missing from the final account table are active_nda_c, is_taxable_c, exclusivity_c, etc.
Expected behavior

I would expect that all available fields in the raw table coming from fivetran would also be present in the final output created by the formula field util and by extension the model within the formula field model table.

dbt Project configurations
  salesforce:
    +snowflake_warehouse: "{{ 'DBT_WH' if target.name == 'prod' else target.warehouse }}"
    base:
      +schema: salesforce_base
    staging:
      +schema: salesforce_staging 
Package versions
  • package: fivetran/salesforce_formula_utils
    version: [">=0.9.0", "<0.10.0"]
What database are you using dbt with?

snowflake

dbt Version

dbt: 1.6.6

Additional Context

No response

Are you willing to open a PR to help address this issue?
  • Yes.
  • Yes, but I will need assistance and will schedule time during our office hours for guidance
  • No.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the issue with fivetran/salesforce_formula_utils versions >=0.9.0 and <0.10.0 using dbt 1.6.6 on Snowflake. Compare the raw account table with the account query in fivetran_formula_model, including fields such as active_nda_c, is_taxable_c, and exclusivity_c, and inspect whether they appear in the failure reason table. Done means all available raw fields are represented in the final output.

Written by the indexing model from the issue text.

Assessment

Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.