5,380 questions with Azure Synapse Analytics tags

Sort by: Updated
2 answers

See modified date/times of Notebooks?

Is there a way, in Azure Synapse Analytics, to see modified date/times of NOTEBOOKS? Or of SQL Scripts -- the "Develop" section objects in general? (Or, is that only available on whatever changes have been checked into GIT / other…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2022-11-28T13:28:19.453+00:00
Doug Ivison 21 Reputation points
accepted 2025-07-10T23:02:13.1133333+00:00
Doug Ivison 21 Reputation points
1 answer One of the answers was accepted by the question author.

Azure Synapse partiioning best practices

Hi, I'm trying to develop a ADLS folder structure to provide analytics via Synapse Spark. The table I want to expose via Spark is: (State, City, Gender, Sum of Population, Sum of deaths, Sum of Births) On ADLS, the folder structure…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-07-08T20:14:08.54+00:00
Jona 680 Reputation points
accepted 2025-07-10T19:06:56.3+00:00
Jona 680 Reputation points
2 answers

Do i need to take the DP-203 exam as it will be retired in march 2025 ?

I'm preparing for DP-203 exam . Since its being retired in march 2025 ,Please advise if I should stop the DP-203 preparation and start preparing for DP-700 ? . Does passing DP-203 a Prerequisite for understanding the contents of DP-700 ?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-01-17T09:56:53.94+00:00
Saravanan Sivasailam 25 Reputation points
answered 2025-07-10T14:02:07.88+00:00
ASPARI CHINNAMAHAMMAD BHASHA 0 Reputation points
1 answer One of the answers was accepted by the question author.

Getting Error while pulling data from fabric lakehouse table: Error code 21446 Details Invalid table! Parquet column is not defined in delta metadata. Column name: _change_type.

Error details Error code 21446 Details Invalid table! Parquet column is not defined in delta metadata. Column name: _change_type. Activity ID: dfc77409-e06f-4ab8-82e1-502ac46f4344 I am trying to preview data for some tables and it is giving me this…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-07-09T22:25:23.3566667+00:00
PATEL, SACHIN KUMAR 40 Reputation points
commented 2025-07-10T06:08:18.9966667+00:00
PATEL, SACHIN KUMAR 40 Reputation points
2 answers One of the answers was accepted by the question author.

Does synapse serverless sql pool OPENROWSET support "parquest based structured stream" format?

I can read from a data lake structured stream using synapse serverless sql pool OPENROWSET, by specifying FORMAT = 'SSTREAM'. Does OPENROWSET support "parquest based structured stream" format? If yes, then what value should I specify to FORMAT…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,562 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2024-05-08T03:27:38.5+00:00
Salander He 66 Reputation points Microsoft Employee
answered 2025-07-09T19:01:00.0433333+00:00
Dipanjan Karmakar 0 Reputation points Microsoft Employee
1 answer

Error on creating Synapse Spark database

Hi every one, I'm trying to create a database in Synapse Spark Notebook, but I'm getting this error: The very same error appears without the keyword LOCATION Regards Jona

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-01-28T13:32:41.94+00:00
Jona 680 Reputation points
commented 2025-07-08T09:56:10.9266667+00:00
Anish, Sukhathankar 5 Reputation points
1 answer One of the answers was accepted by the question author.

Issues with Synapse Workflows After Updating Self-hosted Integration Runtime

After updating the Self-hosted Integration Runtime to version 5.54.9267.1 from 5.44.xx on June 10th, the pipeline runs that previously completed in about 30 minutes are now taking several hours and worsening daily. The Integration Runtime operates…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-06-23T13:01:54.3233333+00:00
John Brynford-Jones 26 Reputation points
accepted 2025-07-07T13:43:37.38+00:00
John Brynford-Jones 26 Reputation points
0 answers

Create DB identity in synapse notebook

Hi, I want to create a Synapse notebook where can read data from Azure SQL server DB. So I need to connect the DB via jdbc and enter the user name and password like code below. Is there a way where I can store this username and password somewhere so that…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-04-24T03:06:32.7566667+00:00
Lotus88 176 Reputation points
commented 2025-07-07T03:53:53.9633333+00:00
SSingh-MSFT 16,371 Reputation points Moderator
2 answers

Unable to switch to data flow debug mode on azure synapse. Failed to setup debug session

I'm currently unable to switch to debug mode in azure synapse workspace and the pipeline runs takes forever to complete if started manually.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2023-04-06T12:53:01.42+00:00
olufisayo 0 Reputation points
answered 2025-07-06T20:48:33.45+00:00
Armaan Singh 0 Reputation points
1 answer

How to enable System Assigned in Azure Synapse?

Hi, Does anyone how to turn on the "system assigned" from Azure Synapse identity? I seems cannot see this option on my Synapse workspace. Is there anything I need to enable in the workspace to see this option? Thanks in advance.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-07-01T07:54:42.9833333+00:00
Lotus88 176 Reputation points
commented 2025-07-04T14:15:25.2866667+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator
1 answer

How to Override Linked Service Parameters (e.g., Databricks domain) in Azure Synapse CI/CD YAML Pipeline?

Hello, I’m currently working on a CI/CD pipeline for Azure Synapse, integrated with Azure DevOps as the source repository. I’ve successfully built and tested the entire deployment pipeline between the Development and QA Synapse workspaces. Everything…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-07-02T18:57:44.8466667+00:00
Napsty 45 Reputation points
commented 2025-07-04T12:05:27.6466667+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator
1 answer

I want to know whether incremental load is possible in case where the source data set is Azure SQL database and sink is REST API.

Hi Team, Does ADF/Azure Synapse pipline support incremental load from Azure SQL Database to REST API ? If yes, Would be very helpful if you could please provide the documentation/ solution. Regards,

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-06-30T08:24:38.3333333+00:00
surjyamani boxi 0 Reputation points
commented 2025-07-03T15:04:27.56+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator
1 answer

Cannot access secrets from notebook call by pipeline

Hi, I have grant secrets permission to my Synapse workspace and my microsoft entra ID. I have notebooks that read the secrets created by me. I can run the notebook to access my secrets and it is working. However when I tried to run the notebook from…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-07-01T09:46:54.2833333+00:00
Lotus88 176 Reputation points
commented 2025-07-03T14:43:12.9066667+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator
3 answers One of the answers was accepted by the question author.

What type of Synapse architecture should be implemented for organisations that are large and have multiple departments working on the same data?

Hello, I am looking for inputs in relation to the synapse strategy that needs to be adopted. I have the below scenario, Company XYZ has different departments (Dept 1, 2, 3 and 4) that are looking to leverage big data platform like Azure Synapse. The data…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-06-25T14:28:17.1866667+00:00
Parameswaran Serussery Narayanan 35 Reputation points
commented 2025-07-01T22:44:18.1566667+00:00
Saurabh Chugh 0 Reputation points
1 answer

Issue using linked service v 2.0 on notebook

Hi, I am accessing the DB in Synapse notebook with linked service version 1. It is working ok but when I changed to version 2, error occurs. Is there any additional setting I need to set in Notebook ? Thank you!

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-05-28T03:35:15.4666667+00:00
Lotus88 176 Reputation points
commented 2025-07-01T05:59:52.29+00:00
Lotus88 176 Reputation points
2 answers One of the answers was accepted by the question author.

Issue with "Too Many Requests" Error in App Provisioning

I ran the code in the test file within Synapse and observed a "Too Many Requests" error while processing records for App provisioning. We also confirmed this issue via Postman, where the same error was encountered.   Can anyone help me to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,657 questions
Azure App Service
Azure App Service
Azure App Service is a service used to create and deploy scalable, mission-critical web apps.
8,977 questions
asked 2024-12-04T14:42:12.2733333+00:00
Vaibhav Patil 255 Reputation points
edited the question 2025-07-01T05:22:13.5133333+00:00
Chandra Boorla 14,680 Reputation points Microsoft External Staff Moderator
1 answer

Synapse Link with F&O

Hello. We have an Azure Synapse Link with F&O, we want to provide access to one element in the team to he can add tables to Sync in the Synapse Link, but unfortunatelly looks like he only can do this with System Adminsitrator permissions. Do you know…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-06-26T17:08:34.36+00:00
Manuel Dones 20 Reputation points
commented 2025-06-30T17:05:17.1666667+00:00
Chandra Boorla 14,680 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Perform Change Data Capture

Hi All, Do you have any pointers on how to perform CDC - change data capture (inserts, updates, deletes) on parquet files in ADLS gen 2 storage. I have another ETL tool called Ab initio but we want synapse to do the heavy lifting.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-06-26T13:49:47.1466667+00:00
Anand Deshpande 20 Reputation points
commented 2025-06-30T15:13:04.6+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Need clarity on Synapse and Data Factory and Databricks

Please spare few mins on my question clearly . I am struggling to convince the customer/interviewer when they need clarification on what service to be used for ingestion , transformation , orchestration , data modelling . I answer this way " We…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-06-30T05:23:14.67+00:00
BathiniShirish-2885 60 Reputation points
accepted 2025-06-30T08:29:19.5566667+00:00
BathiniShirish-2885 60 Reputation points
1 answer

Synapse Notebook code to upload data in SharePoint

In most of the code that I am scanning across to upload file into SharePoint via service principal, sites.readwriteAll application permission is being provided to the app. But that is the highest privilege that an app would get across all SharePoints and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
asked 2025-06-27T10:10:20.65+00:00
Priya Jha 896 Reputation points
commented 2025-06-30T06:40:36.13+00:00
Venkat Reddy Navari 3,630 Reputation points Microsoft External Staff Moderator