Azure SQL Database
An Azure relational database service.
5,147 questions
0 answers
How to copy data from Azure SQL Database to Azure Synapse?
Hello Experts, I am pretty new to Azure Data Factory and struggling with a simple problem. I've done this in SSIS but now trying to implement the same in Azure Data Factory. I have a list of tables that I would like to copy the data on an incremental…
asked 2020-08-30T16:39:04.32+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 19%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
Julaayi
1
Reputation point
commented 2020-09-03T04:43:02.267+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 9%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HarithaMaddi-MSFT
10,131
Reputation points
1 answer
Azure SQL Data Warehouse distribution
Hi, I am working on Azure SQL Data Warehouse(Synapse) in it there is a fact table with nearly 10 billion rows spread across 40 columns. It is a 100DWU server. When I try to fetch records from this table it takes more then 30 mins to pull 9 million rows…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 4%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Unable to load data into Azure Synapse from ADLS Gen 2 .csv file
Hi @ChiragMishraMSFT-1092 Upon trying to load the data from ADLS(csv files) into Azure DW, am encountering a error in loading the data in DW. Here is the error message: "message": "Failure happened on 'Sink' side.…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 96%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
1 answer
Monitoring > Apache Spark applications, not seeing any successes
I'm not seeing any success messages even though my notebooks runs with no issues. Any ideas why?
asked 2020-08-24T16:03:34.837+00:00
Ian Santillan
197
Reputation points
answered 2020-08-28T16:54:22.057+00:00
Ian Santillan
197
Reputation points
4 answers
One of the answers was accepted by the question author.
Identity Column in Synapse
Hello, In Synpase , an identity column is not an auto incremental column similar to normal SQL database identity columns. It provides a unique integer value but not an incremented one like (if previous value is 10 then next value should be 11, it…
asked 2020-08-21T06:13:14.877+00:00
Nandan Hegde
29,891
Reputation points MVP
commented 2020-08-28T04:26:17.28+00:00
Ronen Ariely
15,096
Reputation points
1 answer
One of the answers was accepted by the question author.
Unable to connect to Azure SQL DW & DB via SSMS, SSDT - error 10060
Hi, I'm trying to connect to Azure SQL Data Warehouse via SSMS and SSDT from my local with SQL Authentication and AD universal MFA, but I'm unable to and getting error number 10060 (Connected host failed to respond ). I've added my client IP to…
asked 2020-08-05T16:25:52.757+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 21%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENP%3C/text%3E%3C/svg%3E)
Neil Pereira
81
Reputation points
accepted 2020-08-26T16:15:13.157+00:00
Neil Pereira
81
Reputation points
1 answer
Synapse spark-avro module is external and not included in spark-submit
Hi. I have processing avro files from data lake store gen2 using databricks and it worked fine. Now I am testing the same scenario usinf spark pool of Synapse Analytics. but spark-avro module is external and not included in spark-submit. How can I…
asked 2020-08-19T13:34:26.577+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 60%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERS%3C/text%3E%3C/svg%3E)
Robson Soares
1
Reputation point
commented 2020-08-25T09:42:04.213+00:00
PRADEEPCHEEKATLA-MSFT
77,676
Reputation points Microsoft Employee
1 answer
Querying partitioned data with SQL on-demand?
It is common to partition data within data lakes and this is reflected in the form of a folder hierarchy. What is the proper way to query partitioned data with SQL on-demand within Azure Synapse Analytics, as according to my understanding e.g.…
asked 2020-08-18T11:25:07.39+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 14.000000000000002%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVJ%3C/text%3E%3C/svg%3E)
Veli-Jussi Raitila
381
Reputation points
commented 2020-08-24T19:56:10.89+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT
26,026
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure Synapse Analytics, change database owner
Any one know how to change the database owner on a azure synapse sql database to follow best practice to set owner as a disabled logon. Successfully updated azure sql using the command below but does work on a synapse datase on the same azure sql…
asked 2020-08-19T23:40:19.003+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 8%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDP%3C/text%3E%3C/svg%3E)
Darren Price
21
Reputation points
accepted 2020-08-21T15:54:47.76+00:00
Darren Price
21
Reputation points
0 answers
Generic Error in Synapse Studio Pipeline
Hello, I am just starting to use Synapse Studio. However, I have been using Azure Data Factory for a few months. I have a pipeline that is just a single dataflow activity, copying data from our Azure SQL to Synapse SQL Pool. But I keep getting this…
asked 2020-08-17T23:23:01.177+00:00
Jaryd
181
Reputation points
commented 2020-08-21T15:33:04.217+00:00
HarithaMaddi-MSFT
10,131
Reputation points
2 answers
Real time Data warehouse with Azure Synapse
Hi, I'm working on data warehouse POC for Azure and one of the key questions that I'm working on right now is the solution option where data can be refreshed (every hour, 4 hour or near real-time). Also, need to get an approximate idea of how the cost…
asked 2020-08-10T23:44:15.33+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 0%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
BIFlake
1
Reputation point
commented 2020-08-19T06:08:05.49+00:00
HarithaMaddi-MSFT
10,131
Reputation points
2 answers
One of the answers was accepted by the question author.
SQL build fails in azure dev ops pipelines when selecting Microsoft Azure SQL Data Warehouse as the target platform in Visual Studio
SQL build fails in azure dev ops pipelines when selecting Microsoft Azure SQL Data Warehouse as the target platform in Visual Studio 2019 It succeeds when i change the target platform to Microsoft Azure SQL database, but fails when i change it to SQL…
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,395 questions
Visual Studio
Visual Studio
A family of Microsoft suites of integrated development tools for building applications for Windows, the web and mobile devices.
4,620 questions
Not Monitored
Not Monitored
Tag not monitored by Microsoft.
36,147 questions
asked 2020-08-13T12:18:05.987+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 7.000000000000001%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAD%3C/text%3E%3C/svg%3E)
Albert Dove
21
Reputation points
accepted 2020-08-17T06:19:53.777+00:00
Albert Dove
21
Reputation points
2 answers
Cannot access Azure Synapse DWH on portal, "The resource was not found" error
When I access synapse Datawarehouse on a portal the resource not found error happening. But I am still using data explorer and data factory to connect to this DWH The detailed error as below: Details The resource was not found, it may have been…
asked 2020-08-07T06:03:18.033+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 14.000000000000002%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHD%3C/text%3E%3C/svg%3E)
HUYNH DUY HAI DU
1
Reputation point
commented 2020-08-15T12:52:18.487+00:00
HarithaMaddi-MSFT
10,131
Reputation points
1 answer
One of the answers was accepted by the question author.
Replicated Table Distribution for Small Deployment
Microsoft design guidance suggests using a replicated distribution for small dimensions, such as date. For small service tiers, e.g., less than DW1000 where there is only one compute node allocated, does this selection still have positive impacts on…
asked 2020-07-13T22:29:12.963+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 14.000000000000002%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
Matt
21
Reputation points
commented 2020-08-12T08:08:24.613+00:00
HarithaMaddi-MSFT
10,131
Reputation points
2 answers
how azure synapse on demand calculate data processed ?
for testing purpose I am using a small parquet file, it is only 1.2 MB, but I notice when I check the data processed metrics, I see numbers like 12 mb. my question is does On demand mode for Azure Synapse charge for the compressed data or uncompressed
asked 2020-07-26T03:53:31.203+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 48%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
mim
26
Reputation points
answered 2020-08-10T11:33:08.577+00:00
HarithaMaddi-MSFT
10,131
Reputation points
1 answer
One of the answers was accepted by the question author.
How to setup data retention for Azure synapse analytics?
How do we delete/archive data older than certain time period in Azure synapse Analytics?
asked 2020-07-30T14:53:52.82+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(96, 86%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJV%3C/text%3E%3C/svg%3E)
Jaswanth Vankayalapati
21
Reputation points
accepted 2020-08-05T19:33:33.577+00:00
Jaswanth Vankayalapati
21
Reputation points
1 answer
One of the answers was accepted by the question author.
How to implement Retention Policies in Azure Synapse Analytics (Azure SQL Data Warehouse) ?
Trying to understand how to implement Retention Policies in Azure Synapse Analytics (Azure SQL Data Warehouse). There isn't enough supporting material on the steps to implement retention policies in Azure Synapse Analytics/ SQL Data Warehouse. Does…
asked 2020-07-21T01:37:43.19+00:00
Neil Pereira
81
Reputation points
accepted 2020-08-05T16:08:00.983+00:00
Neil Pereira
81
Reputation points
1 answer
How to pass column list as argument from databricks spark for copy write semantic
Is there a way to pass column list argument for column mapping between spark and synapse table from databricks spark for write semantics as copy as we pass it while running copy command from synapse?
asked 2020-07-23T06:54:16.693+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 43%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
Rishabh
11
Reputation points
commented 2020-08-05T00:32:38.243+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,381
Reputation points Microsoft Employee
1 answer
How big is "Not Big Enough" for Synapse?
We are looking to move our data warehouse to the cloud. We don't have "big data". The biggest table we have has 200 millions rows. Is it cost effective to run a small data warehouse in Synapse? Is there a scenario that exists where you would…
asked 2020-07-26T17:33:53.627+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 9%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJM%3C/text%3E%3C/svg%3E)
John Mihalko
1
Reputation point
commented 2020-07-31T14:43:39.797+00:00
HarithaMaddi-MSFT
10,131
Reputation points
1 answer
One of the answers was accepted by the question author.
How to insert data in Azure Synapse Analytics through Azure Data factory without PolyBase
I have tried using Move and Transfar activity in data factory but I'm getting 2 error at publishing: ' Data flow activity 'dataflow1' requires a stagingLinkedService Data flow activity 'dataflow1' requires a stagingStoragePath ' I don't want to…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 95%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMD%3C/text%3E%3C/svg%3E)