5,385 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

SQL Error [110813] [S0001]: Distribution(s):[25, 47]The Microsoft Distributed Transaction Coordinator (MS DTC) has cancelled the distributed transaction. In azure

while running the azure pipeline we are getting below error. SQL Error [110813] [S0001]: Distribution(s):[25, 47]The Microsoft Distributed Transaction Coordinator (MS DTC) has cancelled the distributed transaction. please let me know how to proceed with…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-07-14T05:32:43.1433333+00:00
Laxman Singh Rawat 0 Reputation points
edited the question 2025-07-14T06:25:12.88+00:00
Anusree Nashetty 4,785 Reputation points Microsoft External Staff Moderator
1 answer

About Synapse Spark Pool vs Dedicates Pool

Hi, I'm trying to find out what tech to use in the consumption zone of a datalake architecture. In this QA (https://learn.microsoft.com/en-us/answers/questions/3717541/azure-synapse-partiioning-best-practices) I asked about which is the best way to model…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-07-12T05:26:54.43+00:00
Jona 680 Reputation points
commented 2025-07-14T05:44:59.86+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator
2 answers

Synapse Spark Pool integration with Power BI

Hi, I have some Spark tables (parquet y deltas) in my Spark Pool. Now, I need Power BI to connect to these tables to run Spark SQL queries to build reports. How can Power BI connect to my Spark Pool? Can I use the Spark Pool endpoint and some kind of…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-07-12T05:33:57.4733333+00:00
Jona 680 Reputation points
answered 2025-07-13T18:32:44.1066667+00:00
Jona 680 Reputation points
3 answers

Matching Synapse dedicated SQL pool vs Spark pool

Hi, I'd like to know the differencies between Synapse dedicated SQl pool and Spark pool, in terms of pros and cons, when it is better to use a Synapse pool and when it is better to use a Spark pool, when it is better to use both. Any suggests to me,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2024-03-30T11:45:28.2+00:00
pmscorca 1,052 Reputation points
answered 2025-07-13T18:13:01.09+00:00
Jona 680 Reputation points
3 answers

ms dtc errors on synapse

We are copying data from a datalake gen 2 to Synapse using the Copy into with a managed identity. We are receiving some errors with some of the files 110806;A distributed query failed: Distribution(s):[1]The Microsoft Distributed Transaction…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2020-10-30T20:47:21.743+00:00
Freeman, Philip 6 Reputation points
answered 2025-07-13T14:58:14.51+00:00
Kleber Rebello 0 Reputation points
1 answer

Why is MFA not enforced for Synapse serverless SQL endpoint for Entra ID?

Hi, I have two Azure tenants each with a synapse workspace set up but MFA is enforced for the serverless SQL endpoint for one but not the other. As far as I can tell the set up is the same in both tenants: Entra Licence: Microsoft Entra ID Free …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-07-11T15:16:03.4766667+00:00
Kevin Chadney 15 Reputation points
commented 2025-07-12T09:10:26.87+00:00
Kevin Chadney 15 Reputation points
0 answers

Can we get more processing in the spark pools as they wont start and we constantly get livvy errors when running a python notebook.

Recent weeks all our processes have stopped working and we cannot allocate more than a single CPU to a notebook. This is causing us such a pain and we can develop in it. We keep getting a LIVVY error even using a small single processor pool. we have…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-07-11T11:19:03.48+00:00
simon blewitt 0 Reputation points
commented 2025-07-11T17:51:28.8+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator
2 answers

See modified date/times of Notebooks?

Is there a way, in Azure Synapse Analytics, to see modified date/times of NOTEBOOKS? Or of SQL Scripts -- the "Develop" section objects in general? (Or, is that only available on whatever changes have been checked into GIT / other…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-11-28T13:28:19.453+00:00
Doug Ivison 1 Reputation point
accepted 2025-07-10T23:02:13.1133333+00:00
Doug Ivison 1 Reputation point
1 answer One of the answers was accepted by the question author.

Azure Synapse partiioning best practices

Hi, I'm trying to develop a ADLS folder structure to provide analytics via Synapse Spark. The table I want to expose via Spark is: (State, City, Gender, Sum of Population, Sum of deaths, Sum of Births) On ADLS, the folder structure…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-07-08T20:14:08.54+00:00
Jona 680 Reputation points
accepted 2025-07-10T19:06:56.3+00:00
Jona 680 Reputation points
2 answers

Do i need to take the DP-203 exam as it will be retired in march 2025 ?

I'm preparing for DP-203 exam . Since its being retired in march 2025 ,Please advise if I should stop the DP-203 preparation and start preparing for DP-700 ? . Does passing DP-203 a Prerequisite for understanding the contents of DP-700 ?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-01-17T09:56:53.94+00:00
Saravanan Sivasailam 25 Reputation points
answered 2025-07-10T14:02:07.88+00:00
ASPARI CHINNAMAHAMMAD BHASHA 0 Reputation points
1 answer One of the answers was accepted by the question author.

Getting Error while pulling data from fabric lakehouse table: Error code 21446 Details Invalid table! Parquet column is not defined in delta metadata. Column name: _change_type.

Error details Error code 21446 Details Invalid table! Parquet column is not defined in delta metadata. Column name: _change_type. Activity ID: dfc77409-e06f-4ab8-82e1-502ac46f4344 I am trying to preview data for some tables and it is giving me this…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-07-09T22:25:23.3566667+00:00
PATEL, SACHIN KUMAR 60 Reputation points
commented 2025-07-10T06:08:18.9966667+00:00
PATEL, SACHIN KUMAR 60 Reputation points
2 answers One of the answers was accepted by the question author.

Does synapse serverless sql pool OPENROWSET support "parquest based structured stream" format?

I can read from a data lake structured stream using synapse serverless sql pool OPENROWSET, by specifying FORMAT = 'SSTREAM'. Does OPENROWSET support "parquest based structured stream" format? If yes, then what value should I specify to FORMAT…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2024-05-08T03:27:38.5+00:00
Salander He 66 Reputation points Microsoft Employee
answered 2025-07-09T19:01:00.0433333+00:00
Dipanjan Karmakar 0 Reputation points Microsoft Employee
1 answer

Error on creating Synapse Spark database

Hi every one, I'm trying to create a database in Synapse Spark Notebook, but I'm getting this error: The very same error appears without the keyword LOCATION Regards Jona

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-01-28T13:32:41.94+00:00
Jona 680 Reputation points
commented 2025-07-08T09:56:10.9266667+00:00
Anish, Sukhathankar 5 Reputation points
1 answer One of the answers was accepted by the question author.

Issues with Synapse Workflows After Updating Self-hosted Integration Runtime

After updating the Self-hosted Integration Runtime to version 5.54.9267.1 from 5.44.xx on June 10th, the pipeline runs that previously completed in about 30 minutes are now taking several hours and worsening daily. The Integration Runtime operates…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-06-23T13:01:54.3233333+00:00
John Brynford-Jones 26 Reputation points
accepted 2025-07-07T13:43:37.38+00:00
John Brynford-Jones 26 Reputation points
0 answers

Create DB identity in synapse notebook

Hi, I want to create a Synapse notebook where can read data from Azure SQL server DB. So I need to connect the DB via jdbc and enter the user name and password like code below. Is there a way where I can store this username and password somewhere so that…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-04-24T03:06:32.7566667+00:00
Lotus88 176 Reputation points
commented 2025-07-07T03:53:53.9633333+00:00
SSingh-MSFT 16,371 Reputation points Moderator
2 answers

Unable to switch to data flow debug mode on azure synapse. Failed to setup debug session

I'm currently unable to switch to debug mode in azure synapse workspace and the pipeline runs takes forever to complete if started manually.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2023-04-06T12:53:01.42+00:00
olufisayo 0 Reputation points
answered 2025-07-06T20:48:33.45+00:00
Armaan Singh 0 Reputation points
1 answer

How to enable System Assigned in Azure Synapse?

Hi, Does anyone how to turn on the "system assigned" from Azure Synapse identity? I seems cannot see this option on my Synapse workspace. Is there anything I need to enable in the workspace to see this option? Thanks in advance.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-07-01T07:54:42.9833333+00:00
Lotus88 176 Reputation points
commented 2025-07-04T14:15:25.2866667+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator
1 answer

How to Override Linked Service Parameters (e.g., Databricks domain) in Azure Synapse CI/CD YAML Pipeline?

Hello, I’m currently working on a CI/CD pipeline for Azure Synapse, integrated with Azure DevOps as the source repository. I’ve successfully built and tested the entire deployment pipeline between the Development and QA Synapse workspaces. Everything…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-07-02T18:57:44.8466667+00:00
Napsty 45 Reputation points
commented 2025-07-04T12:05:27.6466667+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator
1 answer

I want to know whether incremental load is possible in case where the source data set is Azure SQL database and sink is REST API.

Hi Team, Does ADF/Azure Synapse pipline support incremental load from Azure SQL Database to REST API ? If yes, Would be very helpful if you could please provide the documentation/ solution. Regards,

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-06-30T08:24:38.3333333+00:00
surjyamani boxi 0 Reputation points
commented 2025-07-03T15:04:27.56+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator
1 answer

Cannot access secrets from notebook call by pipeline

Hi, I have grant secrets permission to my Synapse workspace and my microsoft entra ID. I have notebooks that read the secrets created by me. I can run the notebook to access my secrets and it is working. However when I tried to run the notebook from…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2025-07-01T09:46:54.2833333+00:00
Lotus88 176 Reputation points
commented 2025-07-03T14:43:12.9066667+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator