IaC folder contains examples of IaC for Databricks using Terraform and Pulumi
- Create a project in Azure DevOps called: devops-for-databricks
- Create an Empty Azure DevOps Repo as clone of this Github repo
- Create an Azure KeyVault with the variables stated below
- Create a Variable Group in Pipeline->Library called: devops-for-dbx-vg
- Connect the Variable Group to the Azure Keyvault and add all the variables
- Create an Azure Artifact feed called: devops-for-databricks
- Run the Pipeline
DBXInstance: Databricks instance, eg: adb-631237481529976.16
ResourceGroup: Resource Group where Databricks instance is
SubscriptionID: Subscription ID where everything runs in Azure
SVCApplicationID: Application (client) ID for the Service Principal
SVCDirectoryID: Directory (tenant) ID for the Service Principal
SVCSecretKey: Secret value for the Service Principal
WorkspaceName: Name of the Databricks Workspace