microsoft / microsoft/fabricnotes

SCD Types - Manage historical change

Open
#47 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Note request
Dominant language
CSS
Stars
118
Forks
31
Avg merge
4d 13h
Merged PRs (30d)
1

Description

What concept do you need more clarity on?

Slowly Changing Dimensions (SCD) are techniques used in data warehousing to manage changes in dimension data over time while maintaining historical accuracy. There are three main types:

  1. SCD Type 1 (Simple Overwrite): Updates the data by replacing the old value without retaining any history.
  2. SCD Type 2 (Full History): Maintains a complete history by adding new rows for each change, with start and end dates.
  3. SCD Type 3 (Limited History): Stores only the most recent change, keeping the previous value in a separate column.

These methods help ensure that historical data is managed according to business requirements for analysis and reporting.

Any reference explaining that concept
https://learn.microsoft.com/en-us/fabric/data-warehouse/dimensional-modeling-dimension-tables#manage-historical-change
https://learn.microsoft.com/en-us/fabric/data-factory/slowly-changing-dimension-type-one
https://learn.microsoft.com/en-us/fabric/data-factory/slowly-changing-dimension-type-two

Have you checked the list of issues to see if there is a similar suggestion?

  • Yes, I have checked (please check this box)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the issue description and its Microsoft Fabric references to understand the requested explanation of Slowly Changing Dimensions. The payload names no target file, test, or entry point; done would require adding a clear project contribution that explains SCD Types 1, 2, and 3.

Written by the indexing model from the issue text.

Assessment

Domain
data-engineering, documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.