5,378 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

Unable to switch to data flow debug mode on azure synapse. Failed to setup debug session

I'm currently unable to switch to debug mode in azure synapse workspace and the pipeline runs takes forever to complete if started manually.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2023-04-06T12:53:01.42+00:00
olufisayo 0 Reputation points
edited a comment 2025-07-06T20:49:02.8833333+00:00
Armaan Singh 0 Reputation points
1 answer

How to enable System Assigned in Azure Synapse?

Hi, Does anyone how to turn on the "system assigned" from Azure Synapse identity? I seems cannot see this option on my Synapse workspace. Is there anything I need to enable in the workspace to see this option? Thanks in advance.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-07-01T07:54:42.9833333+00:00
Lotus88 176 Reputation points
commented 2025-07-04T14:15:25.2866667+00:00
Venkat Reddy Navari 3,465 Reputation points Microsoft External Staff Moderator
0 answers

Cannot access secrets from notebook call by pipeline

Hi, I have grant secrets permission to my Synapse workspace and my microsoft entra ID. I have notebooks that read the secrets created by me. I can run the notebook to access my secrets and it is working. However when I tried to run the notebook from…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-07-01T09:46:54.2833333+00:00
Lotus88 176 Reputation points
commented 2025-07-04T14:14:25.0333333+00:00
Venkat Reddy Navari 3,465 Reputation points Microsoft External Staff Moderator
1 answer

How to Override Linked Service Parameters (e.g., Databricks domain) in Azure Synapse CI/CD YAML Pipeline?

Hello, I’m currently working on a CI/CD pipeline for Azure Synapse, integrated with Azure DevOps as the source repository. I’ve successfully built and tested the entire deployment pipeline between the Development and QA Synapse workspaces. Everything…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-07-02T18:57:44.8466667+00:00
Napsty 45 Reputation points
commented 2025-07-04T12:05:27.6466667+00:00
Venkat Reddy Navari 3,465 Reputation points Microsoft External Staff Moderator
0 answers

Issues with Synapse Workflows After Updating Self-hosted Integration Runtime

After updating the Self-hosted Integration Runtime to version 5.54.9267.1 from 5.44.xx on June 10th, the pipeline runs that previously completed in about 30 minutes are now taking several hours and worsening daily. The Integration Runtime operates…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-23T13:01:54.3233333+00:00
John Brynford-Jones 1 Reputation point
commented 2025-07-04T08:42:18.3166667+00:00
John Brynford-Jones 1 Reputation point
1 answer

I want to know whether incremental load is possible in case where the source data set is Azure SQL database and sink is REST API.

Hi Team, Does ADF/Azure Synapse pipline support incremental load from Azure SQL Database to REST API ? If yes, Would be very helpful if you could please provide the documentation/ solution. Regards,

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-30T08:24:38.3333333+00:00
surjyamani boxi 0 Reputation points
commented 2025-07-03T15:04:27.56+00:00
Venkat Reddy Navari 3,465 Reputation points Microsoft External Staff Moderator
0 answers

Create DB identity in synapse notebook

Hi, I want to create a Synapse notebook where can read data from Azure SQL server DB. So I need to connect the DB via jdbc and enter the user name and password like code below. Is there a way where I can store this username and password somewhere so that…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-04-24T03:06:32.7566667+00:00
Lotus88 176 Reputation points
edited a comment 2025-07-02T05:42:43.75+00:00
Lotus88 176 Reputation points
3 answers One of the answers was accepted by the question author.

What type of Synapse architecture should be implemented for organisations that are large and have multiple departments working on the same data?

Hello, I am looking for inputs in relation to the synapse strategy that needs to be adopted. I have the below scenario, Company XYZ has different departments (Dept 1, 2, 3 and 4) that are looking to leverage big data platform like Azure Synapse. The data…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-25T14:28:17.1866667+00:00
Parameswaran Serussery Narayanan 35 Reputation points
commented 2025-07-01T22:44:18.1566667+00:00
Saurabh Chugh 0 Reputation points
1 answer

Issue using linked service v 2.0 on notebook

Hi, I am accessing the DB in Synapse notebook with linked service version 1. It is working ok but when I changed to version 2, error occurs. Is there any additional setting I need to set in Notebook ? Thank you!

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-05-28T03:35:15.4666667+00:00
Lotus88 176 Reputation points
commented 2025-07-01T05:59:52.29+00:00
Lotus88 176 Reputation points
2 answers One of the answers was accepted by the question author.

Issue with "Too Many Requests" Error in App Provisioning

I ran the code in the test file within Synapse and observed a "Too Many Requests" error while processing records for App provisioning. We also confirmed this issue via Postman, where the same error was encountered.   Can anyone help me to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,640 questions
Azure App Service
Azure App Service
Azure App Service is a service used to create and deploy scalable, mission-critical web apps.
8,961 questions
asked 2024-12-04T14:42:12.2733333+00:00
Vaibhav Patil 255 Reputation points
edited the question 2025-07-01T05:22:13.5133333+00:00
Chandra Boorla 14,665 Reputation points Microsoft External Staff Moderator
1 answer

Synapse Link with F&O

Hello. We have an Azure Synapse Link with F&O, we want to provide access to one element in the team to he can add tables to Sync in the Synapse Link, but unfortunatelly looks like he only can do this with System Adminsitrator permissions. Do you know…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-26T17:08:34.36+00:00
Manuel Dones 20 Reputation points
commented 2025-06-30T17:05:17.1666667+00:00
Chandra Boorla 14,665 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Perform Change Data Capture

Hi All, Do you have any pointers on how to perform CDC - change data capture (inserts, updates, deletes) on parquet files in ADLS gen 2 storage. I have another ETL tool called Ab initio but we want synapse to do the heavy lifting.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-26T13:49:47.1466667+00:00
Anand Deshpande 20 Reputation points
commented 2025-06-30T15:13:04.6+00:00
Venkat Reddy Navari 3,465 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Need clarity on Synapse and Data Factory and Databricks

Please spare few mins on my question clearly . I am struggling to convince the customer/interviewer when they need clarification on what service to be used for ingestion , transformation , orchestration , data modelling . I answer this way " We…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-30T05:23:14.67+00:00
BathiniShirish-2885 60 Reputation points
accepted 2025-06-30T08:29:19.5566667+00:00
BathiniShirish-2885 60 Reputation points
1 answer

Synapse Notebook code to upload data in SharePoint

In most of the code that I am scanning across to upload file into SharePoint via service principal, sites.readwriteAll application permission is being provided to the app. But that is the highest privilege that an app would get across all SharePoints and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-27T10:10:20.65+00:00
Priya Jha 896 Reputation points
commented 2025-06-30T06:40:36.13+00:00
Venkat Reddy Navari 3,465 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Single Pyspark notebook to call multiple notebooks through parameters

I have one pyspark notebook1 which loads one ERP system (ex:A ) , another notebook loads one more ERP system ( ex: B) . I want to create another notebook to call above 2 notebooks through parameters .. the notebook should ask parameter to enter ERP …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2024-04-18T09:43:02.48+00:00
BathiniShirish-2885 60 Reputation points
accepted 2025-06-30T05:27:24.94+00:00
BathiniShirish-2885 60 Reputation points
1 answer

Cost comparison for Azure synapse Analytics and Microsoft fabric

Hello, i have one requirement. Could you please provide the cost comparison Azure synapse analytics vs Microsoft fabric based on below conditions. **CSV File (Data Lake)**7 locations × 4 files (ABC, DEF, GHI and HIJ) = 28 files/day Each file is…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-25T04:58:22.1633333+00:00
Janagam Srikanth 0 Reputation points
commented 2025-06-27T09:10:50.9233333+00:00
Chandra Boorla 14,665 Reputation points Microsoft External Staff Moderator
1 answer

fixing the synapse analytics deployment issues

{"code":"ValidationFailed","message":"Workspace request validation failed, check error details for more…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-25T01:00:36.6833333+00:00
hrishi pal 0 Reputation points
commented 2025-06-27T08:48:25.6966667+00:00
Chandra Boorla 14,665 Reputation points Microsoft External Staff Moderator
1 answer

Missing Database Templates in Synapse

When I try to add a lake database template, the gallery is empty. How can I see the industry templates?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-26T15:17:13.81+00:00
Brandon Gross 0 Reputation points
answered 2025-06-26T16:30:16.93+00:00
Venkat Reddy Navari 3,465 Reputation points Microsoft External Staff Moderator
1 answer

Issues affecting Synapse with "Can't get enough capacity for optimal performance" error

Hello, We have encountered issues in our test & production environments today. No changes have been made to the environments that we are aware off but pipelines in both environments have failed with an "Can't get enough capacity for optimal…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-24T12:55:53.73+00:00
Tori H 0 Reputation points
commented 2025-06-26T10:12:46.0833333+00:00
Venkat Reddy Navari 3,465 Reputation points Microsoft External Staff Moderator
1 answer

Getting Keyboard interrupt error while executing pipeline in Azure Synapse Analytics

Hello, I am using Azure Synapse Analytics to execute a pipeline that loads data from source tables into target tables within an Azure SQL Database. The pipeline follows a parent-child notebook architecture, where the main parent notebook is responsible…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
asked 2025-06-23T12:38:26.08+00:00
Akshay Gopal 5 Reputation points
commented 2025-06-25T13:00:10.33+00:00
J N S S Kasyap 3,780 Reputation points Microsoft External Staff Moderator