4,987 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

Azure Synapse too slow to Open and work on Workspace

Hello- When loading and accessing Synapse workspace is taking a long time. Even it opens up after 20 mins - working around the workspace is very slow. There have been no changes/setting up. The health status looks fine. All env within that subscription…

Azure
Azure
A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.
1,016 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
asked 2024-11-06T09:49:29.67+00:00
Xhevahir Mehalla 25 Reputation points
2 answers

No more allocated vCores on Azure For Students Subscription

Hello, I got an azure for students subscription a week ago and Azure Synapse Spark Pool worked just fine with the allocated 12 vCores that come with the subcription. I only used 2$ of credit as of now, but for some reason, since yesterday, new created…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
asked 2024-10-31T20:23:37.7666667+00:00
Ramzi Belbahri 0 Reputation points
commented 2024-11-06T09:21:42.2+00:00
Chandra Boorla 2,605 Reputation points Microsoft Vendor
1 answer

Request Timeout on ADF Web Activity to Synapse

Hello everyone! I have a set of pipelines in Azure Data Factory (ADF) that trigger Synapse via a Web activity POST request. This setup worked until today around 11 AM CET, but now it’s throwing the following error: Error calling the endpoint. Response…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,823 questions
asked 2024-11-05T15:51:24.8766667+00:00
Erik Martins Tonon 0 Reputation points
commented 2024-11-06T08:54:17.4866667+00:00
Erik Martins Tonon 0 Reputation points
0 answers

Permission Issues with Application Registration for Creating External Users in Azure Synapse Databases

Hello everyone, I’m encountering an issue with an Application Registration in Azure AD that needs to create external users in several on-demand Azure Synapse databases across multiple environments. Despite configuring the necessary permissions in Azure…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
Microsoft Entra
Microsoft Entra ID
Microsoft Entra ID
A Microsoft Entra identity service that provides identity management and access control capabilities. Replaces Azure Active Directory.
22,070 questions
asked 2024-11-06T08:14:30.0266667+00:00
NavasMiguel-4566 0 Reputation points
1 answer

Retrieving schema of scanned assets(files in blob,sql tables) likee column names,datatypes from purview using synapse pyspark notebook.

Hi there, we are having a purview account,synapse with pyspakr, storage account. We are scanning the files in purview that are stored in storage, we are able to see the schema in purview for those files,now we are trying to retrieve the schema f for the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
Microsoft Purview
Microsoft Purview
A Microsoft data governance service that helps manage and govern on-premises, multicloud, and software-as-a-service data. Previously known as Azure Purview.
1,221 questions
asked 2024-11-04T07:18:16.8733333+00:00
Wasim 0 Reputation points
commented 2024-11-06T07:55:11.1066667+00:00
Smaran Thoomu 16,725 Reputation points Microsoft Vendor
2 answers One of the answers was accepted by the question author.

How to share data from one synapse sql pool to another synapse sql pool in different subsciption

How to share data from one synapse sql pool to another synapse sql pool in different subsciption

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
asked 2024-11-05T01:33:07.9566667+00:00
zmsoft 80 Reputation points
commented 2024-11-06T05:07:00.1266667+00:00
Vinodh247 22,951 Reputation points MVP
1 answer

When will Azure Data Explorer pool for Synapse become GA

When will Azure Data Explorer pool for Synapse become GA

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
530 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
asked 2024-11-04T16:19:22.2766667+00:00
Himanshu Zinzuwadia 0 Reputation points
commented 2024-11-06T00:59:43.3066667+00:00
Chandra Boorla 2,605 Reputation points Microsoft Vendor
1 answer

Timeout error due to Error reading SSH protocol banner

Hi Team, We are facing ‘Timeout error due to Error reading SSH protocol banner’ while trying to connect to sftp server through Azure Synapse Notebook. We are using python as source language and paramiko version 2.12.0 to connect to the server and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
asked 2024-11-04T13:32:47.8733333+00:00
Abhilasha Kumar 0 Reputation points
commented 2024-11-06T00:58:25.86+00:00
Chandra Boorla 2,605 Reputation points Microsoft Vendor
1 answer

Permissions error in SSMS with a dataverse datalake

Hello, I'm having an issue with creating a PowerBI report - specifically connecting to a data source. I created a view in a datalake in SSMS based on dataverse data but keep experiencing this issue. My colleague cannot replicate the error and I'm not…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,971 questions
asked 2024-11-05T16:03:32.91+00:00
Jesse Ruiz 0 Reputation points
answered 2024-11-05T18:54:29.32+00:00
Amira Bedhiafi 26,101 Reputation points
1 answer

Unable to see the spark pool I have created while configuring the synapse link for dataverse

I have created a spark pool in my synapse workspace to use it for the delta conversion during configuring the synapse link for dataverse for the D365FO data , unfortunately once I choose the synapse workspace and enabled "Use spark pool for delta…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
asked 2024-11-05T11:42:43.1533333+00:00
Athira Reghuraman 60 Reputation points
answered 2024-11-05T16:27:49.6433333+00:00
Vinodh247 22,951 Reputation points MVP
1 answer

Error on Sink in ADLS Gen2 Data Load: 'Operation Failed Due to Remote Host Connection Reset' - How to Resolve?

Hello, we are experiencing the error below in some Pipelines, when running the trigger schedule the following error appears: Operation on target Load Programacao_Producao_full failed: Failure happened on 'Sink' side.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
asked 2024-11-05T13:03:24.0233333+00:00
PowerBI Romagnole 0 Reputation points
answered 2024-11-05T16:25:35.6666667+00:00
Vinodh247 22,951 Reputation points MVP
1 answer

Apache spark pool 3.3 deprecating but synapse link for dataverse is only supporting 3.3 version

I am trying to create a synapse link for dataverse for the D365FO data export , since the delta lake conversion is mandatory for F&O data I have tried creating a apache spark pool 3.4 version in synapse but it was not showing in the drop down while…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
asked 2024-11-05T13:24:39.3333333+00:00
Athira Reghuraman 60 Reputation points
answered 2024-11-05T16:23:22.2+00:00
Vinodh247 22,951 Reputation points MVP
3 answers

Missing Records in Azure Log Analytics

Hi All, Logs of activities, pipelines, and triggers are gathered within the Synapse environment for monitoring purposes. It has been observed that some pipelines ran successfully, as seen in the Monitor section of Synapse, but there are missing records…

Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
3,314 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,823 questions
asked 2024-10-21T13:55:53.4933333+00:00
Jakub Pytlik 0 Reputation points
commented 2024-11-05T15:42:27.4066667+00:00
Pranay Reddy Madireddy 440 Reputation points Microsoft Vendor
0 answers

How to fix 'Couldn't interpret '0000-07-01' as a valid DateTime' Error in copy activity - synapse analytics pipeline

Hello, Synapse analytics-copy data activity returning below error. But in my case many rows are having "0000-07-01" date in the DB table column. I have tried to change the datatype then to debug. But failed to copy. And then I tried copy…

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,919 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
Azure Database for MySQL
Azure Database for MySQL
An Azure managed MySQL database service for app development and deployment.
845 questions
asked 2024-11-04T15:16:05.7266667+00:00
Shrimathi M 40 Reputation points
commented 2024-11-05T14:47:18.6533333+00:00
Smaran Thoomu 16,725 Reputation points Microsoft Vendor
1 answer

Apache Spark 3.3 will retire but Azure Synapse Link use spark pool for delta conversion only support Apache Spark 3.3

Received email from MS mentioned that Apache Spark 3.3 will retire soon but Azure Synapse Link use spark pool for delta conversion only support Apache Spark 3.3 Any advises on this ?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
asked 2024-08-13T00:46:23.4633333+00:00
Chan Zhen Seng - EYSI 5 Reputation points
commented 2024-11-05T13:16:15.3+00:00
Athira Reghuraman 60 Reputation points
2 answers

How to save complete web activity output to ADLS Gen2 in JSON format? Azure Synapse Studio

I want to save the output of my Web activity (which hits an Api and then fetches data from that Api in Json format) into blob storage account container. Also, my web activity is within a foreach - so multiple Api links are being hit and multiple files…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,823 questions
asked 2024-10-24T05:42:30.79+00:00
Mitashi Malkani 0 Reputation points
commented 2024-11-05T09:28:26.13+00:00
Chandra Boorla 2,605 Reputation points Microsoft Vendor
1 answer

Copy Dataverse data into Azure SQL using Synapse Link

Im using Azure Synapse pipeline to copy data from Dataverse to Azure SQL DB. For large tables, it is only copying 10 million records and it is not inserting after. I have about 15 mil records. I dont see any settings limitation anywhere on the pipeline.…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,823 questions
Microsoft Dataverse Training
Microsoft Dataverse Training
Microsoft Dataverse: A Microsoft service that enables secure storage and management of data used by business apps. Previously known as Common Data Service.Training: Instruction to develop new skills.
37 questions
asked 2024-10-23T15:49:18.2433333+00:00
Murali Ramasamy 5 Reputation points
edited the question 2024-11-05T04:40:03.8733333+00:00
Sumarigo-MSFT 46,446 Reputation points Microsoft Employee
1 answer

Event Trigger is not firing Synapse pipeline

I have created an Event Trigger in Synapse to trigger pipeline based on file arrival in a certain container. The trigger creation created the event subscription in my storage account and whenever I upload a file, I can see the events in the event…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
Azure Event Grid
Azure Event Grid
An Azure event routing service designed for high availability, consistent performance, and dynamic scale.
392 questions
asked 2024-10-25T05:44:05.0166667+00:00
Shaan Shastri 0 Reputation points
edited the question 2024-11-05T04:31:38.92+00:00
Sumarigo-MSFT 46,446 Reputation points Microsoft Employee
0 answers

Autoloader in Synapse

I want to load data incrementally using Azure Synapse Analytics Notebook(dedicated spark pool) there is an option on databricks to load data incrementally which is autoloader so my question was can we use this option in Azure Synapse Analytics…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,213 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,971 questions
asked 2024-01-24T11:33:32.82+00:00
Aditya Singh 160 Reputation points
edited the question 2024-11-05T03:52:58.6933333+00:00
Sumarigo-MSFT 46,446 Reputation points Microsoft Employee
2 answers

Integration runtime is failing

Hi Team, we are unable to run the pipeline using Microsoft Integration Runtime and see following errors. |DEBUG: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown. at …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,987 questions
asked 2024-10-30T13:49:45.89+00:00
Riyaz Ahmed Khaja Hussain 0 Reputation points
answered 2024-11-04T16:09:57.67+00:00
Jonathan Pereira Castillo 8,170 Reputation points Microsoft Vendor