Azure / Azure/Azure-DataFactory

Feature - Add driver_instance_pool_id parameter to Databricks' Linked Services

Open
#408 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
PowerShell
Stars
529
Forks
623
PR merge metrics
No merged PRs in 30d

Description

Nowadays we can select only the instance_pool_id in the Databricks' Linked Service, but something we want to select a different pool for the driver to save money (i.e.: most of the work is done in the workers and driver is only used to coordinate the workers tasks).
From the API documentation (https://docs.microsoft.com/en-us/azure/databricks/dev-tools/api/2.0/jobs) it's possible to set **driver_instance_pool_id** and we have tested that it's works as we expected.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.