4,997 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

Serialization Exception after changing reading from attached ADLS account to the same ADLS Account but through a linked service.

Currently we are running a Synapse Notebook that reads from the "Primary ADLS Gen2 account" and parse data to JSON. This job has been running stable for a while now. We need to run the same logic but read from a different ADLS account instead,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
asked 2024-11-08T22:49:30.5733333+00:00
Jose Gonzalez Gongora 5 Reputation points Microsoft Employee
edited the question 2024-11-11T03:21:11.52+00:00
VarunTha 9,270 Reputation points Microsoft Vendor
1 answer

Permission Issues with Application Registration for Creating External Users in Azure Synapse Databases

Hello everyone, I’m encountering an issue with an Application Registration in Azure AD that needs to create external users in several on-demand Azure Synapse databases across multiple environments. Despite configuring the necessary permissions in Azure…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
Microsoft Entra
Microsoft Entra ID
Microsoft Entra ID
A Microsoft Entra identity service that provides identity management and access control capabilities. Replaces Azure Active Directory.
22,124 questions
asked 2024-11-06T08:14:30.0266667+00:00
NavasMiguel-4566 0 Reputation points
commented 2024-11-10T12:09:54.2666667+00:00
Givary-MSFT 33,156 Reputation points Microsoft Employee
1 answer

Adding a non AKV Linked Service does not modify the publish branch in Azure Synapse Analytics

I tried adding a non-AKV based linked service from a feature branch. As per MS Git troubleshoot doc for synapse, it should publish to the azure live synapse service directly, which it did, but it did not create a commit in the publish branch. The doc is…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
asked 2024-10-31T17:31:49.0666667+00:00
Nandu S Raj 0 Reputation points
commented 2024-11-10T10:46:47.19+00:00
Vinodh247 23,346 Reputation points MVP
1 answer

trying to write data from adlsgen2 to synapse sql dedicated pool but getting data type error

I am trying to write data into a table from adls gen2 using a copy activity. when creating the table, i have to use varchar(max). varchar(8000) is not an option as my data is too big for that. when creating the table using dedicated sql pool, i am able…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,842 questions
asked 2024-11-03T07:20:34.6533333+00:00
Syed Aziz 0 Reputation points
commented 2024-11-10T10:44:28.2233333+00:00
Vinodh247 23,346 Reputation points MVP
1 answer

Error on Sink in ADLS Gen2 Data Load: 'Operation Failed Due to Remote Host Connection Reset' - How to Resolve?

Hello, we are experiencing the error below in some Pipelines, when running the trigger schedule the following error appears: Operation on target Load Programacao_Producao_full failed: Failure happened on 'Sink' side.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
asked 2024-11-05T13:03:24.0233333+00:00
PowerBI Romagnole 0 Reputation points
commented 2024-11-10T10:43:28.8533333+00:00
Vinodh247 23,346 Reputation points MVP
1 answer

Unable to see the spark pool I have created while configuring the synapse link for dataverse

I have created a spark pool in my synapse workspace to use it for the delta conversion during configuring the synapse link for dataverse for the D365FO data , unfortunately once I choose the synapse workspace and enabled "Use spark pool for delta…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
asked 2024-11-05T11:42:43.1533333+00:00
Athira Reghuraman 80 Reputation points
commented 2024-11-10T10:41:48.26+00:00
Vinodh247 23,346 Reputation points MVP
0 answers

Partitioned parquet file into an Azure Database

I inserted a parquet file into an Azure database and it had low throughput so I thought if I partitioned the file I could load the partitions in parallel. I partitioned the file on DefaultRating using pyspark and tried to insert but I'm not getting the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
asked 2024-11-07T10:34:05.4833333+00:00
Iwan 65 Reputation points
edited a comment 2024-11-09T12:31:27.17+00:00
Smaran Thoomu 16,890 Reputation points Microsoft Vendor
0 answers

Unable to query deltalake file in Azure synapse

I have created a synapse link for dataverse for F&O data but when I tried query deltalake file it is throwing the error "Content of directory on path…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
asked 2024-11-07T10:08:53.53+00:00
Athira Reghuraman 80 Reputation points
commented 2024-11-08T18:42:06.91+00:00
phemanth 11,280 Reputation points Microsoft Vendor
0 answers

How to read zip file in Azure Synapse Notebook with extension of .zip.

Hi Team, Could you please advise the pyspark code, how to read zip files in synapse notebook. Example: File_Name - samplefile.zip Note: In the samplefile.zip we have multiple csv files, please let us know. The file Extension is only with .zip. …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,218 questions
asked 2024-11-08T16:44:52.83+00:00
edited a comment 2024-11-08T18:31:27.7233333+00:00
phemanth 11,280 Reputation points Microsoft Vendor
1 answer

How to connect to Function App(Azure Functions) from Azure Synapse Studio

I want to connect my function app through Synapse studio but cannot seem to figure out the configurations. Here is my function.json and function definition along with Synapse configurations. My synapse pipeline basically takes the output of the web…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
5,112 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
asked 2024-11-07T05:30:40.2666667+00:00
Mitashi Malkani 0 Reputation points
commented 2024-11-08T17:36:19.0666667+00:00
LeelaRajeshSayana-MSFT 15,966 Reputation points
0 answers

Unable to delete Azure Synapse Workspace even through Powershell force deletion

Hello Team, I am unable to delete synapse analytics even though following up post through webUI or powershell. I tried following the steps mentioned in the link below :-…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
PowerShell
PowerShell
A family of Microsoft task automation and configuration management frameworks consisting of a command-line shell and associated scripting language.
2,597 questions
asked 2024-11-06T21:31:49.4833333+00:00
vaddi_dataengineer 0 Reputation points
commented 2024-11-08T15:10:08.0333333+00:00
Ganesh Gurram 1,110 Reputation points Microsoft Vendor
1 answer

Azure Synapse too slow to Open and work on Workspace

Hello- When loading and accessing Synapse workspace is taking a long time. Even it opens up after 20 mins - working around the workspace is very slow. There have been no changes/setting up. The health status looks fine. All env within that subscription…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
asked 2024-11-06T09:49:29.67+00:00
Xhevahir Mehalla 25 Reputation points
commented 2024-11-08T15:06:09.99+00:00
Ganesh Gurram 1,110 Reputation points Microsoft Vendor
1 answer

Timeout error due to Error reading SSH protocol banner

Hi Team, We are facing ‘Timeout error due to Error reading SSH protocol banner’ while trying to connect to sftp server through Azure Synapse Notebook. We are using python as source language and paramiko version 2.12.0 to connect to the server and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
asked 2024-11-04T13:32:47.8733333+00:00
Abhilasha Kumar 0 Reputation points
commented 2024-11-08T13:50:20.9633333+00:00
Abhilasha Kumar 0 Reputation points
2 answers

Parametrization for connection string is not working in linked service

Hi there, I have solution - data pipeline in Synapse taking data from mysql database. I need to parametrize it to be able run process across many environemnts (CI/CD). I set many linked services with code referencing on variable in yml file in style…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,842 questions
asked 2024-11-07T19:55:32.4766667+00:00
Peter Michalik 0 Reputation points
answered 2024-11-08T12:17:15.1266667+00:00
Peter Michalik 0 Reputation points
1 answer

Permissions error in SSMS with a dataverse datalake

Hello, I'm having an issue with creating a PowerBI report - specifically connecting to a data source. I created a view in a datalake in SSMS based on dataverse data but keep experiencing this issue. My colleague cannot replicate the error and I'm not…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
14,001 questions
asked 2024-11-05T16:03:32.91+00:00
Jesse Ruiz 0 Reputation points
commented 2024-11-08T12:04:25.97+00:00
phemanth 11,280 Reputation points Microsoft Vendor
0 answers

DeliveryFailedEvent from Azure Event Grid to Synapse trigger with errorCode=RequestEntityTooLarge

I have an event-driven flow where changes in Comsos DB triggers an Azure Function the Azure Function pushes each changed document to a topic in Azure Event Grid a Synapse trigger is triggered and pushes the changed document to a Synapse…

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
5,112 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,671 questions
Azure Event Grid
Azure Event Grid
An Azure event routing service designed for high availability, consistent performance, and dynamic scale.
394 questions
asked 2024-11-08T08:39:37.6+00:00
Hobday, Colin 40 Reputation points
commented 2024-11-08T11:45:25.6333333+00:00
Khadeer Ali 820 Reputation points Microsoft Vendor
1 answer

How to connect to on-prem Analysis server using synapse notebook and uses System assigned managed identity as authentication.

HI Team, I have an on-prem analysis server details like server name and data base name managed by another team, they have provided access to me on the server but now is it possible to use a synapse notebook to connect to on prem analysis svr. Using…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,842 questions
asked 2024-11-07T19:16:05.7266667+00:00
farooq' s 0 Reputation points
answered 2024-11-08T10:45:33.63+00:00
Pinaki Ghatak 4,610 Reputation points Microsoft Employee
0 answers

Identifying Unused Tables in AAS Cube Over the Last 30 Days

I have a question regarding identifying unused tables in Azure Analysis Services (AAS). In our organization, we’re using AAS, and due to limited storage, our cube refresh is failing. I’ve been tasked with finding a list of tables that haven’t been used…

Azure Analysis Services
Azure Analysis Services
An Azure service that provides an enterprise-grade analytics engine.
458 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
SQL Server Reporting Services
SQL Server Reporting Services
A SQL Server technology that supports the creation, management, and delivery of both traditional, paper-oriented reports and interactive, web-based reports.
2,940 questions
asked 2024-11-07T16:03:40.6433333+00:00
madmax 0 Reputation points
commented 2024-11-08T07:34:07.0066667+00:00
Chandra Boorla 2,990 Reputation points Microsoft Vendor
2 answers One of the answers was accepted by the question author.

No more allocated vCores on Azure For Students Subscription

Hello, I got an azure for students subscription a week ago and Azure Synapse Spark Pool worked just fine with the allocated 12 vCores that come with the subcription. I only used 2$ of credit as of now, but for some reason, since yesterday, new created…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
asked 2024-10-31T20:23:37.7666667+00:00
Ramzi Belbahri 20 Reputation points
accepted 2024-11-08T04:58:00.2733333+00:00
Ramzi Belbahri 20 Reputation points
4 answers

How to send a mail notification for a failed pipeline in Azure Synapse Analytics?

How can I send a notification email to a specific email address without using a logic app when one of my Synapse Analytics pipelines fails? I would like to include the error message in the email notification.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,485 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,922 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,997 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,842 questions
asked 2024-03-20T15:48:58.53+00:00
Aditya Singh 160 Reputation points
answered 2024-11-07T21:37:08.3566667+00:00
Manuel Dones 0 Reputation points