Update factory failed. You cannot add CMK settings for factories with existing entities

Adding Customer managed key to brand new Data factory failing with below error message. Same error when i tried from Azure Portal or REST API (PUT https://management.azure.com/subscriptions/#####/resourceGroups/####/providers/Microsoft.DataFactory/factories/ )

I just created Data factory and it is empty. Following below link https://docs.microsoft.com/en-us/azure/data-factory/enable-customer-managed-key. Please let me know how to resolve this issue

```
{
"error": {
"code": "AddCMKToExistingFactoriesWithEntities",
"message": "Update factory failed. You cannot add CMK settings for factories with existing entities",
"target": null,
"details": null
}
}
```