4,422 questions with Azure Synapse Analytics tags

Sort by: Updated
5 answers One of the answers was accepted by the question author.

File cannot be opened because it does not exist or it is used by another process in Azure Synapse workspace

Hi, I created a new Azure Synapse Analytics resource and uploaded some csv files to the data lake storage created with the Synapse. I can see the files in the workspace and preview the files. However, when I tried to create a new SQL script from the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2021-03-19T04:27:04.9+00:00
Bryan Wang 31 Reputation points
commented 2024-05-07T17:31:53.31+00:00
David Hernandez 0 Reputation points
1 answer One of the answers was accepted by the question author.

Automatic updates on source systems

Hi friends, I have a requirement that the business has 12 different upstream sources SAP, CRM, Oracle HCM, SqlServer, PostgreSQL, and multiple other open-source databases and custom applications, etc. and every system has its master record, and just…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,643 questions
asked 2024-05-06T16:17:15.8566667+00:00
Anshal 1,926 Reputation points
commented 2024-05-07T16:47:41.84+00:00
Anshal 1,926 Reputation points
2 answers

How to get notified when synapse integration runtime status is not in running state

Hello, I'm working on setting up a notification system in Azure Synapse Analytics to alert me when my self-hosted Integration Runtime (IR) is not in a 'running' state. My plan is to create a pipeline that retrieves the IR status through a REST API and…

Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
2,826 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-01-17T00:03:25.8333333+00:00
Syed Umair Hasan 90 Reputation points
commented 2024-05-07T16:15:56.9833333+00:00
Syed Umair Hasan 0 Reputation points
0 answers

Pass value from an array selectively to For Each

Hi, I have a parent pipeline that captures values in an array - ArrayFullLoadData. Currently ArrayFullLoadData have three values [A,B,C] and the same is passed to a ForEach with @pipeline.parameters.ArrayFullLoadData. Inside ForEach, values A, B,C are…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-05-03T19:53:04.3366667+00:00
Kumar, Arun 296 Reputation points
commented 2024-05-07T14:52:56.0333333+00:00
Kumar, Arun 296 Reputation points
0 answers

Azure Synapse Error

Hi everyone! I used Metada Driven toll from Azure Synapse Analytics in order to build my pipeline. It works perfectly fine, but onse in while I am getting this error msg. { "errorCode": "2200", "message":…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2022-06-22T15:16:48.76+00:00
Alexandr Brailean 6 Reputation points
commented 2024-05-07T13:27:36.2+00:00
1 answer One of the answers was accepted by the question author.

Synapse workspace deployment node-js supported versions

Hi, I would like to know the list of node.js versions supported for Synapse workspace deployment (Synapse Workspace Deployment@2 task). I can't seem to find any documentation describing the same.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-05-02T13:33:01.2333333+00:00
Raghul Kannan 126 Reputation points
commented 2024-05-07T13:06:36.1966667+00:00
Alisson Hines 0 Reputation points
1 answer

Azure Synapse Analytics Workspace And its Dedicated SQL Pool Migration From one subscription to another subscription during Cross Subscription Migration

I just Want to know that how can I migrate synapse workspace and its dedicated SQL pool from one subscription to another subscription during cross subscription migration

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-05-02T13:20:37.0333333+00:00
Maaz Ahmed Nagori 0 Reputation points
commented 2024-05-07T12:04:46.2+00:00
Smaran Thoomu 10,160 Reputation points Microsoft Vendor
2 answers One of the answers was accepted by the question author.

Cannot register microsoft.Synapse

Hi, I am encountering a problem. No matter how many times I click 'register' on Microsoft Synapse, it always shows as 'NotRegistered'.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-05-06T19:26:29.9633333+00:00
Hua lin 20 Reputation points
accepted 2024-05-07T08:59:03.15+00:00
Hua lin 20 Reputation points
1 answer

Azure Synapse alert for Dedicated SQL Pool

How can I properly set up an alert for a Dedicated SQL Pool in Azure Synapse for CPU Utilization? I want the alert to trigger if the CPU Utilization is more than 90% for an hour continuously. I have set the "check every" to 1 hour and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-04-30T12:44:02.4566667+00:00
Addy 0 Reputation points
commented 2024-05-07T04:08:38.2166667+00:00
ShaikMaheer-MSFT 37,971 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

How to upgrade the Azure Synapse Runtime for Apache Spark 3.1 to version 3.3

We received an email regarding the retirement of Apache Spark 3.1 as of January 26, 2024. There is a notice saying to upgrade to Apache Spark 3.3 when clicking on [Azure Synapse Link for Dataverse] from Power Apps, but I am not seeing the Update option…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-01-12T10:45:46.7933333+00:00
Upul Karunaratne 20 Reputation points
commented 2024-05-07T03:40:46.72+00:00
Smaran Thoomu 10,160 Reputation points Microsoft Vendor
1 answer

InvalidHttpRequestToLivy: Your Spark job requested 12 vcores. However, the workspace has a 0 core limit.

it gives me this error and when i tried to increase core size limit i could not find that option so how to solve this error?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-05-02T20:01:34.8666667+00:00
Janvi Majmundar 0 Reputation points
commented 2024-05-06T19:47:14.13+00:00
BhargavaGunnam-MSFT 26,496 Reputation points Microsoft Employee
1 answer

How to translate database content with Azure Translator by ADF or Synapse notebook?

There is an Azure Database table. Some of columns need to be translated from one language to another into additional columns. Such as from English to Spanish, or Portuguese to English, etc. I am exploring how I can use ADF or Synapse notebook to…

Azure Translator
Azure Translator
An Azure service to easily conduct machine translation with a simple REST API call.
346 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,643 questions
asked 2024-04-22T15:17:46.4133333+00:00
Dataholic 80 Reputation points
edited the question 2024-05-06T19:34:05.7933333+00:00
BhargavaGunnam-MSFT 26,496 Reputation points Microsoft Employee
2 answers One of the answers was accepted by the question author.

Backup/Restore and collation update in Azure Synapse

We have one requirement that to change the collation of Azure SQL serverless database in Azure Synapse Analytics to default collation. So I have 2 questions, 1. How to take backup and restore Azure SQL serverless database in synapse. 2. How to update…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-04-30T14:04:23.77+00:00
Shailesh Ganesh Shripati 90 Reputation points
accepted 2024-05-06T13:55:00.9933333+00:00
Shailesh Ganesh Shripati 90 Reputation points
1 answer

No MediaTypeFormatter is available to read an object of type 'ClusterInfo' from content with media type 'text/html'.

Hi, in azure data factory I wanted to test the connection of our new Databricks Workspace URL and ClusterID. I parameterized the linked service (LS) to global parameters databricksURL and databricksClusterID. When I want to test the connection…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,643 questions
asked 2022-10-18T12:40:54.46+00:00
admin-eGu 16 Reputation points
commented 2024-05-06T13:21:47.4+00:00
Ács Dániel 25 Reputation points
2 answers One of the answers was accepted by the question author.

Cross-db query in Synapse

Hi, I am pretty new to Azure Synapse This post mentions that it is possible to have only one database per SQL pool. However, this post was from 2 years ago. Is this still the case? Assuming that only one database can be created within a SQL pool, is…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2023-07-26T16:45:33.2566667+00:00
prbchic 20 Reputation points
commented 2024-05-06T13:02:23.11+00:00
Ankita Gupta 0 Reputation points
2 answers

No includeDeletedObjects property on Salesforce as source in Copydata activity

Hi! I made the linked service according to the instructions: https://learn.microsoft.com/en-us/azure/data-factory/connector-salesforce?tabs=data-factory#linked-service-properties I set up the dataset according to the instructions. But when I use the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-04-11T15:28:26.9666667+00:00
Fosly 0 Reputation points
commented 2024-05-06T09:22:36.3633333+00:00
AnnuKumari-MSFT 31,151 Reputation points Microsoft Employee
0 answers

Synapse Scala | Read Cosmos DB Container data using managed identity

Hi Team, I tried reading Cosmos data using Managed Identity inside a Synapse Scala notebook, but it's not working as expected. Already provided access for synapse workspace by using below command New-AzCosmosDBSqlRoleAssignment -ResourceGroupName…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,454 questions
asked 2024-05-01T14:01:16.22+00:00
AJITH KUMAR RAI 0 Reputation points
commented 2024-05-06T07:46:28.3866667+00:00
Smaran Thoomu 10,160 Reputation points Microsoft Vendor
5 answers

rename table in synapse

Hi Team, rename table is not working in synapse RENAME OBJECT [dim].[test1] TO [dim].[test]; Parse error at line: 1, column: 49: Incorrect syntax near '.'.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-05-05T10:18:38.7533333+00:00
Vineet S 165 Reputation points
commented 2024-05-06T06:29:30.03+00:00
Smaran Thoomu 10,160 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

Long queue time for copy activity in synapse pipeline

This Synapse Analytics pipeline runs a simple SQL script that joins a table with its change table and outputs the results (less than 100 rows) as a parquet file in Azure Data Lake Storage Gen2. A Copy activity with the SQL script as a source and Storage…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
asked 2024-05-03T09:43:08.2566667+00:00
Vikranth-2626 140 Reputation points
commented 2024-05-05T15:05:05.4333333+00:00
Vikranth-2626 140 Reputation points
2 answers

Can you assist with a Synapse issue involving memory allocation in SQL DW Copy Command in Data Factory, without solely resorting to increasing DWU?

I'm encountering an issue while using the Copy Activity in Data Factory with the Polybase copy option. The error message I receive is as follows: “…..SQL DW Copy Command operation failed with error 'Unable to allocate 257707 KB for columnstore…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,643 questions
asked 2024-04-27T20:11:41.1666667+00:00
EmaLom 0 Reputation points
commented 2024-05-03T12:09:17.97+00:00
Harishga 3,745 Reputation points Microsoft Vendor