Azure / Azure/Azure-DataFactory
COPY activity dynamic column mapping not supported
- Dominant language
- PowerShell
- Stars
- 529
- Forks
- 623
- PR merge metrics
- No merged PRs in 30d
Description
So if you are using a COPY activity and you have columns with different names you have to use a hard coded dataset to provide the mapping. We use parametrized data sets for much of our work (1300 tables are loaded daily)
It feels odd that you can't pass a JSON structure into the copy activity to provide the column mapping. The whole I'll map based on CASE SENSITIVE column names and some ranodm guesswork at the data types (I'm sure it isn't random but as it's not published anywhere or indeed surfaced in any of the outputs it's difficult to figure out what's going on under the covers so it may as well be random)
Being able to PASS in a list of name mappings col1_a--> col1_b and or apply explicit CASTS rather than the implicit ones that currently get imposed feels like it would be a bit of a useful feature (a bit advanced admittedly)
Contributor guide
Assessment
This issue has not been assessed yet.