microsoft / microsoft/Dynamics-365-FastTrack-Implementation-Assets

Changing default schema name prevents change data tables/views from being defined

Open
#158 2 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Jupyter Notebook
Stars
494
Forks
296
Avg merge
1d 10h
Merged PRs (30d)
5

Description

When the default schema value is modified to anything other than a value of "dbo" and real-time updates are enabled which results in a the ChangeFeed folder being created then the anticipated "cdc" prefix is not applied to views or table names in Synapse for the tables located in the ChangeFeed folder. A modification to the manifestToSQLMetadata method in the ManifestHandler.cs file addresses this as seen in the screenshot. Removing the dependency on the schema name allows for the "cdc" prefix to be applied to ChangeFeed tables. The result of not have having this change is that when running the CDMUtil as a Function App whenever an event is fired the views or tables are redefined and could be pointing to either either the Table folder or the ChangeFeed folder in the ADLS depending on the last event processed. CC: @jiyada

2022-09-06_09-51-47

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start in ManifestHandler.cs at manifestToSQLMetadata and review how the schema name controls naming for ChangeFeed tables and views. Compare the behavior with a non-dbo default schema while real-time updates create the ChangeFeed folder. Done means the cdc prefix is applied consistently and Synapse objects continue pointing to the ChangeFeed data rather than switching folders after events.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, csharp
Domain
cloud, databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.