I know as per Azure documentation DataFlow is only allowed in AutoResolve IR (Azure IR), but looking for reason why is it not allowed in Self Hosted IR.!
CodePudding user response:
Data flows requires a Spark environment, which the Azure IR provides. That serverless Spark environment is not provided by self-hosted IR. However, you can achieve the same things in Azure IR as you can in self-hosted IR in terms of accessing data in a vnet and on-prem.
CodePudding user response:
@Mark Kromer MSFT- Another Q being why is this limitation implemented if you know or think of any reason. Say I have onprem data and I want to do ETL operation due to this limitation I will have to do ELT operation.
Hope you getting my point.