Home > Mobile >  why dataflow is not supported by self hosted IR
why dataflow is not supported by self hosted IR

Time:07-27

I know as per Azure documentation DataFlow is only allowed in AutoResolve IR (Azure IR), but looking for reason why is it not allowed in Self Hosted IR.!

CodePudding user response:

Data flows requires a Spark environment, which the Azure IR provides. That serverless Spark environment is not provided by self-hosted IR. However, you can achieve the same things in Azure IR as you can in self-hosted IR in terms of accessing data in a vnet and on-prem.

CodePudding user response:

@Mark Kromer MSFT- Another Q being why is this limitation implemented if you know or think of any reason. Say I have onprem data and I want to do ETL operation due to this limitation I will have to do ELT operation.

Hope you getting my point.

  • Related