Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,259 questions
1 answer
RLS in synapse server-less SQL pool using views
Hi, Issue: In synapse serverless SQL pool when I try to access view data created from file stored in ADLS with AD/Entra users having "Synapse SQL pool admin" rights on the synapse workspace and no direct access to files in ADLS, I am getting…
asked Mar 24, 2025, 1:26 p.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 38%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESC%3C/text%3E%3C/svg%3E)
Srinivas Challagolla
0
Reputation points
edited an answer Mar 26, 2025, 1:40 a.m.
Srinivas Challagolla
0
Reputation points
1 answer
Issue with Person-Type Column in SharePoint List Connection to Synapse
Hi, I attempted to connect a SharePoint list to Synapse, using it as source and sink to new SQL table. I created a SharePoint link service and utilized an OData query in Copy Data. However, the person-type column is only returning data in int32 format.…
asked Mar 25, 2025, 4:55 p.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 24%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHA%3C/text%3E%3C/svg%3E)
Harikrishnan Arayakeel
20
Reputation points
answered Mar 25, 2025, 9:11 p.m.
Amira Bedhiafi
30,746
Reputation points
2 answers
How to create control, orchestration and log tables in serverless pool
I have always used the primary SQL database to dynamically update ETL orchestration details during the ETL process. The ability to update flags is particularly useful. For example I might want to put that a table has been loaded to staging and is ready…
asked Mar 21, 2025, 5:30 p.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 9%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EU%3C/text%3E%3C/svg%3E)
UKjonnyb
0
Reputation points
commented Mar 25, 2025, 6:51 p.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
10,490
Reputation points Microsoft External Staff
0 answers
Azure Synapse notebooks runMultiple() not showing child notebook progress
We are using PySpark notebooks in our Azure Synapse workspace to process our data. Currently we are using belows function to process our notebook in parallel and manage dependencies with a DAG. This works fine, however when one of the notebooks in the…
asked Mar 25, 2025, 8:41 a.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 37%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELP%3C/text%3E%3C/svg%3E)
Lowie Pouwels
0
Reputation points
commented Mar 25, 2025, 6:44 p.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 99%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJN%3C/text%3E%3C/svg%3E)
J N S S Kasyap
1,060
Reputation points Microsoft External Staff
1 answer
One of the answers was accepted by the question author.
Install Packages on Azure Synapse DEP-enabled workspaces
Hi I have a Synapse workspace with DEP enabled. Since PyPI libraries cannot be installed directly in the Spark pool, could you please advise on how to install the azure-mgmt-kusto, azure-kusto-data, and azure-keyvault-secrets packages on the pool? I…
asked Jun 26, 2024, 2:17 a.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(160, 73%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAD%3C/text%3E%3C/svg%3E)
Abhiram Duvvuru
236
Reputation points Microsoft Employee
commented Mar 25, 2025, 2:01 p.m.
Maksymilian Krysa
0
Reputation points
2 answers
installing wheel packages on spark pool - Synapse DEP enabled workspaces
Hi, I have a Synapse workspace with DEP enabled, and since PyPI libraries cannot be installed directly in the Spark pool, I want to install azure-mgmt-kusto and azure-kusto-data on the pool. I tried the following methods but encountered the error…
asked Jul 5, 2024, 11:13 p.m.
Abhiram Duvvuru
236
Reputation points Microsoft Employee
commented Mar 25, 2025, 1:40 p.m.
Maksymilian Krysa
0
Reputation points
0 answers
Daily runtime hours of Synapse Workspace
I would like to analyze the daily runtime hours and associated costs for our Azure Synapse workspace. Specifically, I want to understand the total number of hours the workspace runs each day and the corresponding cost per run.
asked Mar 25, 2025, 4:52 a.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 42%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
Prabhu
40
Reputation points
commented Mar 25, 2025, 10:30 a.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
5,220
Reputation points Microsoft External Staff
1 answer
Synapse Create Lake Database Table using a Parquet file from python
I have a Lake Database in Synapse - Not a SQL DatabaseTo date I have been creating tables manually in the workspace GUI choosing "Create external table from data lake" and selecting a parquet file from my Azure Storage.I want to use Python to…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 27%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EW%3C/text%3E%3C/svg%3E)
1 answer
Investigating and solving UserErrorSqlDWCopyCommandError error
Hi, I'm managing some ADF pipelines to write data on a Synapse Analytics dedicated SQL pool. Sometimes, not always, some pipelines finish with a timeout error. In particular, for an ADF pipeline I've the UserErrorSqlDWCopyCommandError error, with this…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 41%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Granting the right permission to select a system view in a Synapse dedicated SQL pool
Hi, in terms of minimum permissions, in a Synapse dedicated SQL pool I've created an Entra user by assigning the db_datareader and db_datawriter roles and granting the execute permission on a specific stored procedure that selects from the…
1 answer
One of the answers was accepted by the question author.
Apache spark pool 3.4 - upgrade during a spark job execution
Hi, I need to upgrade from Apache Spark pool 3.3 to 3.4 in prod environment. Considering that there are continuous data changes, what happens if I start the upgrade to 3.4 during a spark job 3.3 execution? Do you suggest waiting the end of a possible…
asked Mar 21, 2025, 12:15 p.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 9%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDF%3C/text%3E%3C/svg%3E)
Diego Fosso
20
Reputation points
accepted Mar 25, 2025, 9:25 a.m.
Diego Fosso
20
Reputation points
1 answer
One of the answers was accepted by the question author.
In synapse pipeline which activity is better, stored procedure or sql pool stored procedure
I would like to understand the main difference between stored procedure vs sql pool stored procedure activities in Synapse pipelines. Which is better to execute stored procedure against sql dedicated pool?. Need insights from both performance and cost…
asked Mar 22, 2025, 2:20 a.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(140.8, 91%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPM%3C/text%3E%3C/svg%3E)
PRABHAKARAN MATHIVANAN
20
Reputation points
commented Mar 25, 2025, 2:31 a.m.
Ganesh Gurram
5,220
Reputation points Microsoft External Staff
3 answers
One of the answers was accepted by the question author.
Azure Data Factory / Synapse: paging method for copy activity and data flow source work diffrently
Hi everyone, me again fighting with the REST sources in synapse. I finally discovered how paging methods work in a copy activity. This is the projection of the payload coming from the graph api: If more than 100 records in the value…
asked Feb 11, 2022, 3:34 p.m.
Paul Hernandez
686
Reputation points Microsoft Employee
answered Mar 24, 2025, 5:11 p.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 89%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EL4%3C/text%3E%3C/svg%3E)
Lolas-4729
10
Reputation points
0 answers
Connection to our Azure environment from Power BI Desktop, SSMS, Power BI Online, etc is not working.
Simple queries in SSMS are taking extremely long and not completing. Power BI Desktop dataset refresh continues to simply state "Waiting for Synapse" before eventually timing out. We have production reports that are not updating due to this…
asked Mar 24, 2025, 4:44 p.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 31%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERW%3C/text%3E%3C/svg%3E)
Ryan Wright
0
Reputation points
commented Mar 24, 2025, 5:10 p.m.
Vinodh247
30,521
Reputation points MVP
1 answer
Duplicate inserted in synapse table Id column ( Identity 1,1 )
Hi All , I see Duplicate inserted in synapse table Id column even given that column given as Identity(1,1). Is there any reson for this issue? generally it should not insert duplicates. Is there any root cause and solution for this is gr8 helpfull to us…
asked Mar 22, 2025, 4:19 a.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 19%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Srinivas K
11
Reputation points
commented Mar 24, 2025, 4:59 p.m.
Srinivas K
11
Reputation points
1 answer
One of the answers was accepted by the question author.
Dedicated vs serverless pools - difference and performance
I am working with dedicated pools in Azure Synapse, but never had a concrete understanding when to use them and when to use the serverless pools. What is the difference between them in terms of performance and what are the best practices ?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 64%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EW%3C/text%3E%3C/svg%3E)
1 answer
Why my Copy Data Activity is getting Low Throughput and Connection Failures in Azure Synapse Analytics ?
Scenario: Large volumes of data are being pulled from an on-prem SQL Server into Azure Data Lake using an Azure Synapse pipeline. The data is partitioned into 30 batches of 20 million records each. The Copy Data activity loops through these partitions…
asked Mar 17, 2025, 12:36 p.m.
Vedant Desai
656
Reputation points
edited an answer Mar 24, 2025, 1:31 p.m.
J N S S Kasyap
1,060
Reputation points Microsoft External Staff
2 answers
One of the answers was accepted by the question author.
Change in JSON representation of Synapse Notebooks? "\r\n" → "\n"
Hi, We have the git-integration enabled for our Synapse workspace (West EU). Starting mid of last week, we are seeing a change in the JSON representation of Synapse Notebooks in git. Linebreaks within a code cell of a notebook used to be represented by…
asked Aug 20, 2024, 3:12 p.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 42%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMB%3C/text%3E%3C/svg%3E)
Martin B
126
Reputation points
commented Mar 24, 2025, 10:46 a.m.
Thomas McNeilly
20
Reputation points
0 answers
Synapse Notebook Syntax has been changed
Hello, For visibility purposes, I would like to put this question here. The linting syntax for Notebooks in Azure Synapse Analytics has recently changed. Previously, the format used \r\n for new lines, as shown below: { "cell_type":…
asked Aug 15, 2024, 9:12 a.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 9%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZK%3C/text%3E%3C/svg%3E)
Z.K.Z
221
Reputation points
commented Mar 24, 2025, 10:46 a.m.
Thomas McNeilly
20
Reputation points
1 answer
Fabric Capacity
Hi team , If I am using dedicated SQL pool tiers DW2000c in Azure synapse. how do i know which Fabric capacity (SKU,CU) should I use if i have to migrate to Fabric Can anyone give a detailed comparison Compute capacity of both Azure synpase to…
asked Mar 19, 2025, 10:44 a.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 10%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHN%3C/text%3E%3C/svg%3E)
Handoo, Nihar
0
Reputation points
commented Mar 24, 2025, 9:30 a.m.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 50%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVR%3C/text%3E%3C/svg%3E)
Venkat Reddy Navari
365
Reputation points Microsoft External Staff