Unable to switch to data flow debug mode on azure synapse. Failed to setup debug session
I'm currently unable to switch to debug mode in azure synapse workspace and the pipeline runs takes forever to complete if started manually.
Azure Synapse Analytics
How to enable System Assigned in Azure Synapse?
Hi, Does anyone how to turn on the "system assigned" from Azure Synapse identity? I seems cannot see this option on my Synapse workspace. Is there anything I need to enable in the workspace to see this option? Thanks in advance.
Azure Synapse Analytics
Cannot access secrets from notebook call by pipeline
Hi, I have grant secrets permission to my Synapse workspace and my microsoft entra ID. I have notebooks that read the secrets created by me. I can run the notebook to access my secrets and it is working. However when I tried to run the notebook from…
Azure Synapse Analytics
How to Override Linked Service Parameters (e.g., Databricks domain) in Azure Synapse CI/CD YAML Pipeline?
Hello, I’m currently working on a CI/CD pipeline for Azure Synapse, integrated with Azure DevOps as the source repository. I’ve successfully built and tested the entire deployment pipeline between the Development and QA Synapse workspaces. Everything…
Azure Synapse Analytics
Issues with Synapse Workflows After Updating Self-hosted Integration Runtime
After updating the Self-hosted Integration Runtime to version 5.54.9267.1 from 5.44.xx on June 10th, the pipeline runs that previously completed in about 30 minutes are now taking several hours and worsening daily. The Integration Runtime operates…
Azure Synapse Analytics
I want to know whether incremental load is possible in case where the source data set is Azure SQL database and sink is REST API.
Hi Team, Does ADF/Azure Synapse pipline support incremental load from Azure SQL Database to REST API ? If yes, Would be very helpful if you could please provide the documentation/ solution. Regards,
Azure Synapse Analytics
Create DB identity in synapse notebook
Hi, I want to create a Synapse notebook where can read data from Azure SQL server DB. So I need to connect the DB via jdbc and enter the user name and password like code below. Is there a way where I can store this username and password somewhere so that…
Azure Synapse Analytics
What type of Synapse architecture should be implemented for organisations that are large and have multiple departments working on the same data?
Hello, I am looking for inputs in relation to the synapse strategy that needs to be adopted. I have the below scenario, Company XYZ has different departments (Dept 1, 2, 3 and 4) that are looking to leverage big data platform like Azure Synapse. The data…
Azure Synapse Analytics
Issue using linked service v 2.0 on notebook
Hi, I am accessing the DB in Synapse notebook with linked service version 1. It is working ok but when I changed to version 2, error occurs. Is there any additional setting I need to set in Notebook ? Thank you!
Azure Synapse Analytics
Issue with "Too Many Requests" Error in App Provisioning
I ran the code in the test file within Synapse and observed a "Too Many Requests" error while processing records for App provisioning. We also confirmed this issue via Postman, where the same error was encountered. Can anyone help me to…
Azure Synapse Analytics
Azure Data Factory
Azure App Service

Synapse Link with F&O
Hello. We have an Azure Synapse Link with F&O, we want to provide access to one element in the team to he can add tables to Sync in the Synapse Link, but unfortunatelly looks like he only can do this with System Adminsitrator permissions. Do you know…
Azure Synapse Analytics
Perform Change Data Capture
Hi All, Do you have any pointers on how to perform CDC - change data capture (inserts, updates, deletes) on parquet files in ADLS gen 2 storage. I have another ETL tool called Ab initio but we want synapse to do the heavy lifting.
Azure Synapse Analytics
Need clarity on Synapse and Data Factory and Databricks
Please spare few mins on my question clearly . I am struggling to convince the customer/interviewer when they need clarification on what service to be used for ingestion , transformation , orchestration , data modelling . I answer this way " We…
Azure Synapse Analytics
Synapse Notebook code to upload data in SharePoint
In most of the code that I am scanning across to upload file into SharePoint via service principal, sites.readwriteAll application permission is being provided to the app. But that is the highest privilege that an app would get across all SharePoints and…
Azure Synapse Analytics
Single Pyspark notebook to call multiple notebooks through parameters
I have one pyspark notebook1 which loads one ERP system (ex:A ) , another notebook loads one more ERP system ( ex: B) . I want to create another notebook to call above 2 notebooks through parameters .. the notebook should ask parameter to enter ERP …
Azure Synapse Analytics
Cost comparison for Azure synapse Analytics and Microsoft fabric
Hello, i have one requirement. Could you please provide the cost comparison Azure synapse analytics vs Microsoft fabric based on below conditions. **CSV File (Data Lake)**7 locations × 4 files (ABC, DEF, GHI and HIJ) = 28 files/day Each file is…
Azure Synapse Analytics
fixing the synapse analytics deployment issues
{"code":"ValidationFailed","message":"Workspace request validation failed, check error details for more…
Azure Synapse Analytics
Missing Database Templates in Synapse
When I try to add a lake database template, the gallery is empty. How can I see the industry templates?
Azure Synapse Analytics
Issues affecting Synapse with "Can't get enough capacity for optimal performance" error
Hello, We have encountered issues in our test & production environments today. No changes have been made to the environments that we are aware off but pipelines in both environments have failed with an "Can't get enough capacity for optimal…
Azure Synapse Analytics
Getting Keyboard interrupt error while executing pipeline in Azure Synapse Analytics
Hello, I am using Azure Synapse Analytics to execute a pipeline that loads data from source tables into target tables within an Azure SQL Database. The pipeline follows a parent-child notebook architecture, where the main parent notebook is responsible…