SQL Server 2022 - Is it allowing communication to Data Lake Data Brick directly

Avik Mukherjee 1 Reputation point
2022-12-02T07:16:49.307+00:00

Dear Microsoft (SQL/Azure) Experts,

We noted SQL Server 2022 release Data Sheet mentioned, Seamless analytics over on-prem operational data : Break the wall between operational and analytical stores with Azure Synapse Link for SQL Server

I'd like to ask what this means, Are we going to get any reasonable way to connect Azure Data Lake or Data Bricks from SQL Server /SSMS etc. Currently with SQL Server 2019 I don't think its possible. Even to connect SSIS to Data Brick, I guess we need to additionally purchase a Licensed connector to do so. right?

266399-image.png

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,337 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,913 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. PRADEEPCHEEKATLA-MSFT 76,746 Reputation points Microsoft Employee
    2022-12-05T11:31:55.007+00:00

    Hello @Avik Mukherjee ,

    Thanks for the question and using MS Q&A platform.

    Are we going to get any reasonable way to connect Azure Data Lake or Data Bricks from SQL Server /SSMS etc.

    No - you cannot connect to Azure Data Lake or Databricks from SQL Server /SSMS. You can use the Azure Synapse Link for SQL functionality to replicate your operational data into an Azure Synapse Analytics dedicated SQL pool from SQL Server 2022.

    Currently, to move data from an on-premises database to Azure Synapse, you use the ETL (Extract-Transform-Load) tool. It requires ETL pipeline configuration. However, there is a lag in the real-time data processing. Therefore, the Azure Synapse link in SQL 2022 enables you with automatic change feeds. This change feed captures the real-time changes in the SQL Server database and feeds that data into the Azure Synapse Analytics.

    Note: SQL Server 2022 Azure Synapse Link breaks the wall between operational and analytical stores with Azure Synapse Link for SQL Server. You get the following benefit using this feature.

    • Hybrid transactional processing
    • Analytical processing
    • Near real-time analysis
    • Minimal impact on the source (operational) system

    You can leverage synapse data using Azure Machine Learning, Power BI, Spark, combine data with many different data sources such as Azure Data Lake Storage, SQL pools.

    For more details, refer to Azure Synapse Link for SQL Server 2022.

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is jhow you can be part of Q&A Volunteer Moderators
    0 comments