microsoftgraph / microsoftgraph/dataconnect-solutions

Private Endpoint, Data Connect and Blob Storage

Open
#270 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Jupyter Notebook
Stars
72
Forks
52
PR merge metrics
No merged PRs in 30d

Description

Receiving 403 error when my pipeline reads from DataConnect and saves into Blob.

{
"errorCode": "2200",
"message": "ErrorCode=UserErrorOffice365DataLoaderError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Office365 data loading failed to execute. office365LoadErrorType: PermanentError. Operation on target 67a42e0a-145a-495c-9cb6-103d5c556609_Activity failed: ErrorCode=AzureBlobFailedToCreateContainer,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Unable to create Azure Blob container. Endpoint: 'https://gbusmgdcconvlineage01.blob.core.windows.net/', Container Name: 'managers'.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.WindowsAzure.Storage.StorageException,Message=The remote server returned an error: (403) Forbidden.,Source=Microsoft.WindowsAzure.Storage,StorageExtendedMessage=RequestId:0b5d4c5a-801e-0012-7e4d-00367a000000 Time:Mon, 16 Oct 2023 16:25:27 GMT,,''Type=System.Net.WebException,Message=The remote server returned an error: (403) Forbidden.,Source=System,',Source=Microsoft.DataTransfer.ClientLibrary,'",
"failureType": "UserError",
"target": "M365ManagersToAZBS",
"details": []
}

I know my Private endpoints are correct, synapse can test connectivity and I can create a simple copy job but when reading from data connect then writing to blob i get this.

Are these technologies not compatible? Is there a work around?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the failed pipeline activity that reads from Data Connect and writes to Azure Blob Storage, then compare it with the simple copy job that succeeds. Review the reported 403 error, private endpoint configuration, and Synapse connectivity results. Done means establishing whether this combination is supported and documenting a confirmed workaround or a reproducible compatibility finding.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure
Domain
cloud, data-engineering, networking
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.