Polybase and Azure Synapse Analytics

Question

Polybase and Azure Synapse Analytics

Jayesh Dave 296

Hello:

To my basic understanding, I can use Polybase for Data Virtualization.

Instead of importing\ELT\ingesting On-Prem data into Azure Synapse Analytics (Dedicated SQL Pool), I want to use Polybase to do Data Virtualization, so that I can directly query on-prem SQL Server Databases.

I want to learn & understand, how to configure\create Polybase for Data Virtualization on Azure, so that I can query my on-prem databases and from Dedicated SQL Pool.

Do I have to create a new Azure SQL Instance to configure\create for Polybase for Data Virtualization ???

Any help or link is greatly appreciated.

Thanking in advance.

Accepted answer

0 additional answers

Your answer

Answer 1

PRADEEPCHEEKATLA 90,651 Moderator

Hello @Jayesh Dave ,

Thanks for the question and using Microsoft Q&A platform.

The PolyBase feature provides connectivity via Azure Blob Storage and Azure Data Lake Store.

This table lists the key features for PolyBase and the products in which they're available.

If you are exporting from SQL Server, you can use bcp command-line tool to export the data into delimited text files.

For more details, refer the below articles:

Design a PolyBase data loading strategy for dedicated SQL pool in Azure Synapse Analytics

Introducing data virtualization with PolyBase.

Hope this helps. Do let us know if you any further queries.

------------

Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

Jayesh Dave 296 Reputation points

2021-05-17T15:15:44.503+00:00

Hello Pradeep:

Thanks for your reply, my question is purely on Polybase Data Virtualization and based on the link, I believe that it can be done on-prem and not on Azure Cloud?
PRADEEPCHEEKATLA 90,651 Reputation points Moderator

2021-05-18T10:18:52.733+00:00

Hello @Jayesh Dave ,

The above answers clearly explain that in order to use PolyBase in Azure Synapse Analytics, you need to first import data to Azure Blob Storage or Data lake storage.

Hope this helps.
Jayesh Dave 296 Reputation points

2021-05-18T12:26:22.487+00:00

Pradeep:

There is disconnect here, my question is on Data Virtualization not using Polybase to do ELT. Also I read that Polybase doesn't support SQL Server version 2012 & 2014.

We are using Denodo for data virtualization and I want to understand to what extent Polybase can help to replace Denodo???
PRADEEPCHEEKATLA 90,651 Reputation points Moderator

2021-05-19T10:21:54.803+00:00

Hello @Jayesh Dave ,

Thanks for the follow-up question.

We are reaching out to the internal team to get more help on this, I will update you once we hear back from them.
PRADEEPCHEEKATLA 90,651 Reputation points Moderator

2021-05-20T12:07:34.823+00:00

Hello @Jayesh Dave ,

We will keep expanding our data virtualization capabilities to include support for wider set of data sources (in-cloud or on-prem), including SQL.

Share via

Polybase and Azure Synapse Analytics

0 additional answers

Your answer