Force App Service to update Key Vault values referenced by the app

Hi,
I noticed that with the new UI changes on App Services, there is new button in the "Environment variables" section - "Fetch latest values".


Scenario:
I have Key Vault values referenced in the "Environment variables" and I updated one of the secret values in the KV. According to the documentation I restarted App Service few times. I expected the KV referenced secret value will update in the App Service. When I checked in Kudu, after restarts there was still the old KV value. When I pressed the button "Fetch latest values", the App Service restarted and new KV secret referenced value was refetched.


I have more than 25 App Services to go through and "click the button" to refetch KV referenced values. The most efficient way of working would be old behavior - restarting App Service triggers refetching KV referenced values.
I didn't find proper documentation explaining new behavior. I would like to force refetching new values from KV via AZ CLI or PowerShell.
For now the known "workaround" is to set the variable to some random value and then switch back to KV reference. It's not efficient as it requires multiple terraform deployments and creates longer downtime on our services.