microsoft / microsoft/Dynamics-365-FastTrack-Implementation-Assets
NVARCHAR(MAX) Datatypes Table Columns of D365 is truncated to NVARCHAR(1000) by using DATALAKETOSQL pipeline
Nobody has claimed this yet.
- Dominant language
- Jupyter Notebook
- Stars
- 494
- Forks
- 296
- Avg merge
- 1d 10h
- Merged PRs (30d)
- 5
Description
There are two tables are not loading any data into dedicated pool due to below mentioned error by using Datalaketosql pipeline. This is happening in change feed files. Please suggest how to fix this.
"errorCode": "2011", "message": "Bulk load data conversion error (type mismatch or invalid character for the specified codepage) for row starting at byte offset 0, column 80 (SpecialWeightTxt) in /ridprod.operations.dynamics.com/ChangeFeed/CTMContractHdr/0X007206080003D0180192_1_0X007206080003A3C8000E.csv
"errorCode": "2011", "message": "Bulk load data conversion error (type mismatch or invalid character for the specified codepage) for row starting at byte offset 0, column 77 (SpecialWeightTxt) in /ridprod.operations.dynamics.com/ChangeFeed/CTMContractHdrHistory/0X0072060B0027A1280013_2_0X0072060B002706500153.csv.",
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the DATALAKETOSQL pipeline and the change feed CSV files for CTMContractHdr and CTMContractHdrHistory, focusing on the SpecialWeightTxt column and its NVARCHAR definition. Compare the source column length with the dedicated pool table definition and verify that both tables load the affected rows without bulk-load conversion errors.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- sql
- Domain
- data, database
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100