Home > front end >  Can I create a linked server connection to Databricks using SSMS?
Can I create a linked server connection to Databricks using SSMS?

Time:12-15

I have a SQL Server that currently has a linked server to an Oracle DB.

The Oracle DB is moving to Azure Databricks.

Can I create a linked server from my SQL Server using SSMS to create the connection to AZ Databricks?

CodePudding user response:

Can I create a linked server from my SQL Server using SSMS to create the connection to AZ Databricks?

No. And even if you could, no. But you can stand up a Azure Synapse Serverless SQL Pool in front of your Data Lake and create a linked server to that.

Serverless SQL pool is a query service over the data in your data lake. It enables you to access your data through the following functionalities:

A familiar T-SQL syntax to query data in place without the need to copy or load data into a specialized store. Integrated connectivity via the T-SQL interface that offers a wide range of business intelligence and ad-hoc querying tools, including the most popular drivers. Serverless SQL pool is a distributed data processing system, built for large-scale data and computational functions. Serverless SQL pool enables you to analyze your Big Data in seconds to minutes, depending on the workload. Thanks to built-in query execution fault-tolerance, the system provides high reliability and success rates even for long-running queries involving large data sets.

Azure Databricks doesn't store data. The data is stored in the Azure Data Lake, and both Azure Databricks and Synapse Serverless SQL Pool can read the data and serve queries over it. But to query through Databricks requires running a cluster, and there's not a supported driver stack for Linked Server.

Synapse Serverless gives you a normal TDS endpoint and TSQL access to the Data Lake so you can create a linked server to it. And Serverless supports Delta, Parquet, and CSV, so however your data is stored in the Data Lake clients can query it through the Serverless endpoint.

  • Related