microsoft / microsoft/Dynamics-365-FastTrack-Implementation-Assets
Unable to generate [TableName].manifest.cdm.json with headers using CDMUtil solution as Function App
Nobody has claimed this yet.
- Dominant language
- Jupyter Notebook
- Stars
- 494
- Forks
- 296
- Avg merge
- 1d 10h
- Merged PRs (30d)
- 5
Description
We are using Tier 1 D365 environment hence referred to https://github.com/microsoft/Dynamics-365-FastTrack-Implementation-Assets as we could not install Export to Data Lake Addin.
We are facing an issue when the function tries to generate [TableName].manifest.cdm.json file as it does not populate the headers
Missing Header Definitions in Group.manifest.cdm.json
{
"manifestName": "Group",
"entities": [
{
"type": "LocalEntity",
"entityName": "CustGroup",
"entityPath": "CustGroup.cdm.json/CustGroup",
"dataPartitions": [
{
"name": "CustGroup-data",
"location": "/CustGroup/*.csv",
"exhibitsTraits": [
{
"traitReference": "is.partition.format.CSV",
"arguments": [
{
"name": "columnHeaders",
"value": "false"
},
{
"name": "delimiter",
"value": ","
}
]
}
]
}
]
}
],
"jsonSchemaSemanticVersion": "1.4.0",
"imports": [
{
"corpusPath": "cdm:/foundations.cdm.json"
}
]
}
When checking the logs of createManifest in CDMUtilAzureFunctions App, I see a Error: message=Could not read '/foundations.cdm.json' from the 'cdm' namespace. Reason 'HTTP NotFound - Not Found. (see below)
createManifest Error Message:
message=Could not read '/foundations.cdm.json' from the 'cdm' namespace. Reason 'HTTP NotFound - Not Found. Response headers: Access-Control-Allow-Origin:*, Cache-Control:max-age=0, Date:Mon, 24 Jul 2023 01:27:15 GMT, Server:Blob,Service,Version,1.0,Microsoft-HTTPAPI/2.0, x-ms-request-id:727427a4-d01e-0057-3fcd-bda0fd000000. URL: /logical/foundations.cdm.json'
at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions) at CDMUtil.Manifest.ManifestWriter.createManifest(EntityList entityList, ILogger logger, Boolean createModelJson) in C:\Users\Adminfab28c8e7e\source\repos\Dynamics-365-FastTrack-Implementation-Assets\Analytics\CDMUtilSolution\CDMUtil\Manifest\ManifestHandler.cs:line 0
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with createManifest in CDMUtilSolution/CDMUtil/Manifest/ManifestHandler.cs and reproduce the logged lookup for /foundations.cdm.json in the cdm namespace. Trace the Function App's CDM namespace configuration and manifest generation flow; done means the createManifest error is resolved and the generated table manifest contains the expected header definitions.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure
- Domain
- backend, data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 42/100