Azure / Azure/Azure-DataFactory

COPY activity dynamic column mapping not supported

Open
#278 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
PowerShell
Stars
529
Forks
623
PR merge metrics
No merged PRs in 30d

Description

So if you are using a COPY activity and you have columns with different names you have to use a hard coded dataset to provide the mapping. We use parametrized data sets for much of our work (1300 tables are loaded daily)

It feels odd that you can't pass a JSON structure into the copy activity to provide the column mapping. The whole I'll map based on CASE SENSITIVE column names and some ranodm guesswork at the data types (I'm sure it isn't random but as it's not published anywhere or indeed surfaced in any of the outputs it's difficult to figure out what's going on under the covers so it may as well be random)

Being able to PASS in a list of name mappings col1_a--> col1_b and or apply explicit CASTS rather than the implicit ones that currently get imposed feels like it would be a bit of a useful feature (a bit advanced admittedly)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.