Add custom parameters to Azure Data Factory deployment-CodePudding

I need a help to access a linked service parameter during Azure Data Factory deployment or find some other way to set a parameter during deployment even if the parameter is not automatically added for editing.

I am using continuous integration for Azure Data Factory using Azure DevOps pipeline (i.e. all pipelines and connections are first created in a test resource and then deployed through Azure DevOps pipeline to production resource,

CodePudding user response：

It is easy to be lost with parameters and variables in Azure Data Factory. Good idea can be to specify it via global parameters and use it as central control place for variables:

CodePudding user response：

To be able to edit values that are not automatically available during the deployment, you have to add them to the ARM template parameters.

go to the Manage tab in Azure Data Factory,
select ARM template,
click on edit parameter configuration,
in the part "Microsoft.DataFactory/factories/linkedServices" there is specification for parameter extraction for all linkd services (marked with *) - below you can add the following which will allow you to edit the Databricks domain during deployment:

"AzureDatabricks": {
            "properties": {
                "typeProperties": {
                    "domain": "="
                }
            }
        }

you need to save it (by clicking OK) and publish the Data Factory (you will not see it among changes for publish but it will affect the ARM template generation)

Then you will be able to override the value during Azure DevOps pipeline deployment.

More information on ARM template parameters https://docs.microsoft.com/en-us/azure/data-factory/continuous-integration-delivery-resource-manager-custom-parameters