4,768 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer One of the answers was accepted by the question author.

Is there a list of error codes and their meaning

Hi, As part of custom audit logs, we want to capture errors in case something fails. We tried with getting message from failed activity, but they can be very long, especially in case Notebook fails. So we wanted to switch to store error code, and have a…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,389 questions
asked 2024-08-08T11:50:14.06+00:00
DEDev 20 Reputation points
accepted 2024-08-12T06:50:56.72+00:00
DEDev 20 Reputation points
1 answer One of the answers was accepted by the question author.

Can't run Azure Fabric Notebook cells in VS Code

Hey, I am trying to get Azure Fabric Notebook to work with VS Code using the Synapse Visual Studio Code Extension as described in: https://learn.microsoft.com/en-us/fabric/data-engineering/setup-vs-code-extension I managed to install the prerequisites,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
Microsoft Fabric Training
Microsoft Fabric Training
Microsoft Fabric: A Microsoft unified data platform.Training: Instruction to develop new skills.
36 questions
asked 2024-08-02T08:59:58.2233333+00:00
Mike Cornelis 20 Reputation points
accepted 2024-08-12T06:29:04.17+00:00
Mike Cornelis 20 Reputation points
1 answer

How to fix on this error

Started executing query at Line 1 File 'https://datameshpoc.dfs.core.windows.net/datamesh-poc/Loan_Servicing.csv' cannot be opened because it does not exist or it is used by another process. Visit this article to learn more about this error Total…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2024-08-01T20:50:58.0233333+00:00
prithvi.sriramprasad 0 Reputation points
commented 2024-08-12T04:29:35.6966667+00:00
PRADEEPCHEEKATLA-MSFT 87,326 Reputation points Microsoft Employee
2 answers

Unexpected $500 Billing for Azure Synapse

I activated the Azure Synapse service on August 1st using the default settings. However, I noticed that I am being billed $250 per day, which has accumulated to a total of $500 over the last two days. As a student, I am using this service solely for…

Azure Cost Management
Azure Cost Management
A Microsoft offering that enables tracking of cloud usage and expenditures for Azure and other cloud providers.
2,418 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,389 questions
asked 2024-08-03T18:13:18+00:00
Paramjeet Singh 0 Reputation points
commented 2024-08-12T04:11:25.31+00:00
PRADEEPCHEEKATLA-MSFT 87,326 Reputation points Microsoft Employee
6 answers One of the answers was accepted by the question author.

Azure synapse Write access to spark pool not working

Hi, I am trying to install a package from azure devops to a synapse spark pool. I am getting an error for my managed identity that it does not have authorization to perform action 'Microsoft.Synapse/workspaces/bigDataPools/write'. The managed identity…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
Azure Role-based access control
Azure Role-based access control
An Azure service that provides fine-grained access management for Azure resources, enabling you to grant users only the rights they need to perform their jobs.
740 questions
asked 2024-08-09T22:12:32.2766667+00:00
Chavi Gupta 121 Reputation points Microsoft Employee
commented 2024-08-10T08:46:20.7066667+00:00
Konstantinos Passadis 18,881 Reputation points MVP
1 answer

How to copy data from oracle on-prem database to Azure Synapse analytics

Currently, I have configured a project in Synapse Analytics. I have the following problem: I have created a linked server that points to an Oracle database in a local environment; however, it does not allow access and returns the following error when I…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2024-08-07T17:03:37.5066667+00:00
Paul Berrones López 0 Reputation points
answered 2024-08-09T21:04:39.32+00:00
Bhargava-MSFT 29,716 Reputation points Microsoft Employee
1 answer

Use Self Hosted Integration Runtime in Feature Branch

I have created one Self Hosted Integration Runtime in Synapse Workspace in Collaboration Branch. I want all developers to use that IR in their Feature Branch. I don't want to merge the collaboration branch to feature branch as developer has already done…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2024-08-06T15:15:11.8433333+00:00
Gaurav Dhuppar 21 Reputation points
commented 2024-08-09T18:46:04.24+00:00
Bhargava-MSFT 29,716 Reputation points Microsoft Employee
7 answers

Error trying to validate storage account name while creating a new synapse workspace

I am unable to create a new data lake storage (gen2) account name in the basic tab for create Azure Synapse Workspace. The error I get is - " There was an error trying to validate storage account name. please try again ". The error message is…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,445 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2022-08-03T07:01:54.587+00:00
Jozure 521 Reputation points
commented 2024-08-09T17:46:54.03+00:00
Varun Yadav 0 Reputation points
0 answers

My python code uses AzureCliCredential() function, but it is giving error in running in Synapse/ADF/Databricks notebook .

My python code uses AzureCliCredential() function, but it is giving error in running in Synapse Workspace that your Azure Cli command not found on path . I have tried using other function like DefaultAzureCredentials(), ClientSecretCredentials () also…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,116 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,389 questions
asked 2024-07-18T18:55:12.8266667+00:00
Utsav Mori 20 Reputation points
commented 2024-08-09T13:59:20.79+00:00
phemanth 9,360 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

TEMPDB ran out of space during spilling out in Azure Synapse SQL pool

Hi All, we are facing the Issue with TEMPDB full in Synapse SQL Pool. Due to this, our Daily jobs getting failed.# Does anyone come across this issue? Kindly help to clear off TEMPDB space in synapse SQL pool. Thanks in Advance

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2024-07-31T12:06:28.34+00:00
Kalidas Yerravarapu 20 Reputation points
commented 2024-08-09T09:45:21.86+00:00
Kalidas Yerravarapu 20 Reputation points
0 answers

How to copy D365 data into Azure SQL db

Hello, This is going to be long winded so please bear with me. For the past year I've been extracting data out of D365 using the basic set up of a Synapse Link with incremental folder updates in Power Apps for the dumping of data in a storage account and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,389 questions
asked 2024-07-31T10:37:35.89+00:00
Diana Rus 0 Reputation points
commented 2024-08-09T09:41:11.7266667+00:00
Diana Rus 0 Reputation points
1 answer

what parameters should be defined for a dataflow activity

Hello Having set up a new pipeline using a previously defined dataset, I am getting an error. I am trying to remove duplication in all tables using code snippet for distinct rows. I am not clear what the parameters should be? Thanks in advance

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,389 questions
asked 2024-08-08T18:07:39.7033333+00:00
Asil SHind 0 Reputation points
commented 2024-08-09T07:28:26.9166667+00:00
Asil SHind 0 Reputation points
1 answer

Disable activity within pipeline in Azure Synapse/Data Factory

We are building a Data Warehouse on Synapse using ETL. We need a way to stop and start activities automatically in case of issues or during deployments, as the current manual disable/enable option is impractical for production. Is there an alternative…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,389 questions
asked 2024-08-02T10:17:36.0133333+00:00
Kunal Kishore 0 Reputation points
commented 2024-08-09T07:02:29.44+00:00
AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee
1 answer

How to connect on-prem SQL Server using Synapse Notebook

Hi Team, we have to connect to on-prem SQL Server using synapse notebook we have the below details to connect to it. Server=tcp:N11-xxxxxxxx.com;Initial Catalog=xxxx;User ID=xx;Password=xx we have tried the below syntax it is not working, Could you…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2024-08-06T09:32:26.5866667+00:00
commented 2024-08-08T10:40:13.9133333+00:00
PRADEEPCHEEKATLA-MSFT 87,326 Reputation points Microsoft Employee
1 answer

Deployment Managed Private Endpoints for PrivateLink Service via Azure DevOps failing

We have an issue with deploying Managed Private Endpoints (MPEs) for PrivateLink Service from Azure DevOps via Synapse Workspace deployment extension, the deployment task returns following error (shortened/redacted): ##[error]Encountered with…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2024-08-02T00:30:52.6733333+00:00
MartinKralovic-2666 0 Reputation points
commented 2024-08-07T23:19:52.8933333+00:00
Bhargava-MSFT 29,716 Reputation points Microsoft Employee
3 answers One of the answers was accepted by the question author.

How to run another Synapse Notebook from one Synapse Notebook

I try to run another Synapse notebook in one Synapse notebook. And I found the documents for using %run or mssparkutils.notebook.run, but both of them failed. when I use %run, I got the error below, but as you can see that the notebook is there. When…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2023-04-14T15:44:46.26+00:00
Shao Peng Sun 81 Reputation points
edited a comment 2024-08-07T22:08:02.46+00:00
Saulo Tipas 0 Reputation points
0 answers

Copying data from DB2 to Azure SQL Database using copy data activity and getting Invalid Parameter Error

"errors": [ { "Code": 11402, "Message": "Failure happened on 'Source' side. ErrorCode=InvalidParameter,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The value of the property 'index' is…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2024-03-11T14:13:56.1566667+00:00
Gaurav Agarwal 0 Reputation points
commented 2024-08-07T21:00:36.26+00:00
Cory Seaman 1 Reputation point
2 answers One of the answers was accepted by the question author.

Synapse sql pool to Fabric

We are currently utilizing a Synapse dedicated pool database for our data warehousing needs. We are planning to migrate to Microsoft Fabric to leverage its enhanced capabilities and features. Could you provide detailed guidance on the best approach for…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2024-08-06T04:21:29.62+00:00
DataCoder 60 Reputation points
commented 2024-08-07T16:14:40.37+00:00
DataCoder 60 Reputation points
3 answers One of the answers was accepted by the question author.

Synapse Workspace | pandas.read_excel is not working on a new cluster

Hello, I have a new spark pool with spark version of 3.4: I was trying to read excel file via Pandas but got an error: Basically, from the same path I'm able to read CSV file but not able to read excel file what makes me think that it is connected…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2024-08-04T11:26:30.25+00:00
Tamashevich, Tatsiana 85 Reputation points
accepted 2024-08-07T15:25:23.22+00:00
Tamashevich, Tatsiana 85 Reputation points
1 answer One of the answers was accepted by the question author.

How can I use the Range function in the dynamic expression editor of the Data Flow Pagination Rules?

With a Copy Activity pagination rules, you can use a Range function to generate a range of values for the offset like this : "paginationRules": { "AbsoluteUrl.{offset}": "RANGE:0:$.meta.total_count:1000" } But this is…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,768 questions
asked 2022-09-02T13:08:51.99+00:00
Chaiwa 56 Reputation points
commented 2024-08-07T13:05:23.4933333+00:00
Kit MacInnes-Manby 0 Reputation points