Azure / Azure/Azure-DataFactory
Staged copy works toward Unity Catalog in Azure Databricks?
- Dominant language
- PowerShell
- Stars
- 529
- Forks
- 623
- PR merge metrics
- No merged PRs in 30d
Description
According to [this instruction](https://learn.microsoft.com/en-us/azure/data-factory/connector-azure-databricks-delta-lake?tabs=data-factory), I was supposed to load data to a table in Unity Catalog in Azure Databricks.
But as a [sink dataset](https://learn.microsoft.com/en-us/azure/data-factory/connector-azure-databricks-delta-lake?tabs=data-factory#dataset-properties), I could specify only `database` and `table`. I thought I could insert `catalog`, `schema`, `table`. I tried to insert `catalog.schema` in `database`, but it did not work and I could not see preview of data. Is `staged copy` functionality actually works against a table in Unity Catalog? If so, what is more recommended pattern of data loading between `staged copy` and `copy activity & auto loader`?
Contributor guide
Assessment
This issue has not been assessed yet.