Azure / Azure/Azure-DataFactory
Feature - Add driver_instance_pool_id parameter to Databricks' Linked Services
Open
- Dominant language
- PowerShell
- Stars
- 529
- Forks
- 623
- PR merge metrics
- No merged PRs in 30d
Description
Nowadays we can select only the instance_pool_id in the Databricks' Linked Service, but something we want to select a different pool for the driver to save money (i.e.: most of the work is done in the workers and driver is only used to coordinate the workers tasks).
From the API documentation (https://docs.microsoft.com/en-us/azure/databricks/dev-tools/api/2.0/jobs) it's possible to set **driver_instance_pool_id** and we have tested that it's works as we expected.
Contributor guide
Assessment
This issue has not been assessed yet.