ADE Command Activity in pipeline will not use User Assigned Managed Identity

I am working on an ADF pipeline that has an Azure Data Explorer Command activity as the first activity in the pipeline. We are using a User Assigned Managed Identity for authentication, so all of the permissions are tied to it. When I run the pipeline in debug mode or if I manually trigger the pipeline. it fails and throws Forbidden exceptions and displays the AppId of the System Assigned Managed Identity - which we are not using.
I checked the connection and confirmed that it is setup to use the User Assigned Managed Identity. I have tested the connection successfully. I'm not sure why the activity it is trying to authenticate with the System Assigned Managed Identity.