Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,813 questions
0 answers
Error in Pipeline: Failure happened on 'destination' side. ErrorCode=DeltaNotSupportedAction
My colleague and I keep running into this error in our pipeline. From our understanding we don't do anything with Meta Data. Does anyone have a resolution? Failure happened on 'destination' side.…
asked 2024-08-29T14:19:52.38+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 92%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
jvenegas3
0
Reputation points
commented 2024-08-30T17:03:57.06+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 46%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
NIKHILANETHIKUNTA
1,350
Reputation points Microsoft Vendor
5 answers
Forbidden 403 when trying to create a delta table in oneLake with notebook using sql
Created a spark dataframe from the csv files and also created a view TableTempView on top of this dataframe. When I try to create a table in the lakehouse using below code %%sql create table if not EXISTS Bronze_Sales21 using DELTA as select * from…
asked 2024-08-13T06:46:10.3733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(160, 48%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Siva Reddy
30
Reputation points
answered 2024-08-30T15:34:54.24+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(25.6, 85%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHH%3C/text%3E%3C/svg%3E)
hero herobetcv
0
Reputation points
1 answer
SQL Query to calculate size of each schemas in Azure data warehouse and to find last access time?
Hi, Is there any SQL query that could help me get the size of each schemas present in our Azure Data Warehouse service and also to find when was it last accessed? I checked and found one query below which can help me find the size of each table in…
asked 2024-08-29T11:37:15.3733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 1%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Suraj Pardeshi
0
Reputation points
commented 2024-08-30T14:50:59.36+00:00
Suraj Pardeshi
0
Reputation points
1 answer
Which role allows to add a client IP as a firewall rule for a Synapse Analytics workspace
Hi, I need to know which is the Synapse RBAC role or Azure role allows to add a client IP as a firewall rule for a Synapse workspace. Thanks
1 answer
CI/CD Azure Synapse Analytics with GitHub Actions
Trying to create a CI/CD process using GitHub Actions without having to click the publish button in a synapse workspace, as well as, merge between different environments. Is it possible to do via GitHub actions without having to use Azure DevOps?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 40%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDB%3C/text%3E%3C/svg%3E)
1 answer
Flatten a JSON Nested Array in Azure Synapse pipeline
I am trying to flatten a JSON which has nested array objects with 1:M mapping. Please refer below JSON response. { "result": [ { "data": [ { "dimensions": [ …
asked 2024-08-29T18:01:41.31+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 0%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
sachin gupta
376
Reputation points
edited an answer 2024-08-30T13:45:26.1533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
14,140
Reputation points Microsoft Vendor
1 answer
How do I get a notification for Azure Synapse Workspace Publishes
We have an Azure Synapse Workspace in live mode. We do have a DevOps release pipeline that is used to deploy changes to the pipelines/artifacts. The aforementioned Workspace that is used as the target workspace for release deployments is kept in live…
asked 2024-08-30T10:28:11.8166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 49%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENN%3C/text%3E%3C/svg%3E)
Nicholas Nguyen
0
Reputation points
answered 2024-08-30T13:10:12.0766667+00:00
Vinodh247
16,201
Reputation points
1 answer
How getting the client IP to add as a firewall rule for Synapse Analytics
Hi, I need to get the client IP to add a firewall rule for Synapse. Which is the command to use, please? Thanks
2 answers
Enabling auto update statistics for a Synapse dedicated SQL pool
Hi, I'd like if and when it is proper to enable the auto update statistics option for a Synapse dedicated SQL pool. Thanks
asked 2024-03-16T16:36:10.9533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 41%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
pmscorca
987
Reputation points
commented 2024-08-30T12:10:06.2166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 96%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENR%3C/text%3E%3C/svg%3E)
Nirmal Ram P K
0
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Synapse Integration Runtime with public subtype when Managed virtual network is enabled
Hello, I have created a synapse analytics workspace with managed virtual network enabled. This is so that I can use private endpoints to access a sql database that has public access disabled. The access to this resource uses a newly created integration…
asked 2024-08-29T08:40:24.7166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 28.999999999999996%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFS%3C/text%3E%3C/svg%3E)
Finn Schmidt
86
Reputation points
commented 2024-08-30T11:57:06.8266667+00:00
Finn Schmidt
86
Reputation points
2 answers
Can you give me example for shared responsibility and service model related to like facebook?
I started learning azure i cannot see the big picture how it works.can i get an example like how facebook or instagram works in cloud computing based on their shared responsibility and their service model?
asked 2024-08-14T14:06:36.5166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 13%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMA%3C/text%3E%3C/svg%3E)
muhammad asyraf norudin
0
Reputation points
commented 2024-08-30T07:59:17.82+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 69%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Sai Raghunadh M
75
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
How to find who updated the Azure Synapse sql database objects
Hi All, We have granted access to the Active Directory User groups in our Azure Synapse SQL database objects. I can see the AD group which has created or updated a database object, I am trying to see which individual user has done the change. Can someone…
asked 2024-08-26T23:34:14.21+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 49%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVN%3C/text%3E%3C/svg%3E)
Vasuki Nimalan
20
Reputation points
accepted 2024-08-30T06:53:47.24+00:00
Vasuki Nimalan
20
Reputation points
1 answer
Synapse troubleshoot %run in live vs debug
Hello, I am having difficulty getting %run notebook to work in Synapse live for notebook not sharing the same path. I do not have problems when the path is the same. I have tried no quotes and with quotes. I have tried path with a "/" in front…
asked 2024-08-21T14:37:01.78+00:00
Jesse Horn-Artera
0
Reputation points
commented 2024-08-30T05:58:52.54+00:00
NIKHILANETHIKUNTA
1,350
Reputation points Microsoft Vendor
0 answers
Optimizing Azure Synapse Analytics for Spark Pool and Mapping Data Flows
I am encountering errors involving Livy sessions when running multiple pipelines in Synapse Notebook and mapping data flows. The errors are as follows: For notebooks: Operation on target forecast_constrained failed: Exception: Failed to create Livy…
asked 2024-08-29T08:21:28.3033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 69%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Aditya Singh
130
Reputation points
commented 2024-08-30T05:46:44.69+00:00
NIKHILANETHIKUNTA
1,350
Reputation points Microsoft Vendor
2 answers
What is the reason for Azure synapse pipeline activity is in queue for a longer time?
Just like few days back the issue Data Factory failures or pipeline run delays in East US is back in East US. The Pipelines are all queued up and failed to enable the interactive authoring capability.
asked 2024-08-27T21:30:01.7266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 10%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJD%3C/text%3E%3C/svg%3E)
Jhaveri, Darshan
40
Reputation points
commented 2024-08-30T05:01:35.36+00:00
Vinodh247
16,201
Reputation points
1 answer
One of the answers was accepted by the question author.
How to create and use separate Spark sessions/apps within the same notebook session?
We process data in various logical steps from raw to curated where we persist intermediate results for each of the steps and the following steps starts with reading the predecessor results (similar to medallion architecture pattern). This allows us to…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 42%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMB%3C/text%3E%3C/svg%3E)
1 answer
Azure Synapse Error: This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry later.
I am receiving this error message since yesterday afternoon when running a Synapse Pipeline that is using SQL Serverless. The Pipeline usually runs twice a day without any issues. [This query cannot be executed because we can't get enough capacity for…
asked 2024-08-14T08:54:19.33+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 97%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
M S
0
Reputation points
edited an answer 2024-08-29T19:09:16.71+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
Bhargava-MSFT
30,381
Reputation points Microsoft Employee
1 answer
Binding errors in azure synapse studio when i try querying the view
We have recently facing issues when trying to run the query on top of a parquet file for view or an external table. Nothing has changed in our setup. This issue seems to come and go after a few minutes; we are able to query the view as normal, but this…
asked 2023-06-30T13:35:44.3+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 5%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPK%3C/text%3E%3C/svg%3E)
Prashanthi Kamasani
0
Reputation points
commented 2024-08-29T18:42:42.4566667+00:00
Rob Plata
1
Reputation point
2 answers
Synapse Analytics workspace not deploying to separate workspace using GitHub Actions
My synapse analytics workspace is integrated with GitHub, dedicated sql pools are the exact same between development workspace and uat workspace. Target workspace is indicated within the yaml files yet none of the published ARM templates will publish to…
1 answer
How does Azure Data Factory's Data Copy REST API pagination rules work, is there any parallelisation and can this be disabled to only copy one page at a time?
Hello, I'm using the copy data activity in a Azure Data Factory pipeline to copy data from a REST API data source (the pipeline will soon be migrated to a Synapse one). A recent update to the source API has stumped me as using the built in pagination…
asked 2024-08-29T16:56:09.3266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(182.40000000000003, 54%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
Kit MacInnes-Manby
0
Reputation points
commented 2024-08-29T17:08:22.7566667+00:00
Kit MacInnes-Manby
0
Reputation points