5,005 questions with Azure Synapse Analytics tags

Sort by: Updated
2 answers

Parametrization for connection string is not working in linked service

Hi there, I have solution - data pipeline in Synapse taking data from mysql database. I need to parametrize it to be able run process across many environemnts (CI/CD). I set many linked services with code referencing on variable in yml file in style…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,873 questions
asked 2024-11-07T19:55:32.4766667+00:00
Peter Michalik 0 Reputation points
commented 2024-11-15T19:30:22.4433333+00:00
phemanth 11,450 Reputation points Microsoft Vendor
1 answer

Getting error "Login failed for user '

I have a resource group under which I have created a sql pool and Synapse workspace. Whenever I am running a query like "CREATE SCHEMA foodmart" it is giving the following error. "Login failed for user '

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
asked 2024-11-14T10:31:52.93+00:00
Shiv 0 Reputation points
commented 2024-11-15T14:01:37.6733333+00:00
Ganesh Gurram 1,350 Reputation points Microsoft Vendor
3 answers

In my ADF I have few pipelines, is it possible to Export / Migrate those pipelines in Synapse Analytics...?

In ADF I have grouped all the activities in the form of Pipelines, So is it possible to migrate or export those pipelines in Azure Synapse.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,873 questions
asked 2024-11-13T01:17:17.1666667+00:00
Shreyash Betwar 0 Reputation points
commented 2024-11-15T13:57:07.51+00:00
Ganesh Gurram 1,350 Reputation points Microsoft Vendor
1 answer

Need to automate a Synapse Analytics Pipeline to gather the information from the previous day. every day

I have a Synapse Analytics Pipeline that gather information from SharePoint and put it into a storage account container in Azure. It is a Copy data action. Right now, every time I need to get more data, I need to change the date on Source /Date filter…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
asked 2024-11-12T20:28:56.61+00:00
Alex Nieto Castro 0 Reputation points
edited a comment 2024-11-15T13:36:06.82+00:00
Ganesh Gurram 1,350 Reputation points Microsoft Vendor
2 answers

How to save complete web activity output to ADLS Gen2 in JSON format? Azure Synapse Studio

I want to save the output of my Web activity (which hits an Api and then fetches data from that Api in Json format) into blob storage account container. Also, my web activity is within a foreach - so multiple Api links are being hit and multiple files…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,873 questions
asked 2024-10-24T05:42:30.79+00:00
Mitashi Malkani 0 Reputation points
commented 2024-11-15T11:20:49.2+00:00
Chandra Boorla 3,230 Reputation points Microsoft Vendor
1 answer

How can I write to a Dataverse lookup using an alternate key?

Hi I want to write data to Dataverse via a Synapse Copy Data task in a pipeline. The destination tables all have alternate keys set up. So for example, I could have a Country entity, with CountryAlternateKey (e.g. ISO code) and Name, and a City with…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,873 questions
asked 2024-11-13T10:32:20.5433333+00:00
Duncan Pryde 1 Reputation point
commented 2024-11-15T09:55:48.2733333+00:00
Chandra Boorla 3,230 Reputation points Microsoft Vendor
0 answers

Identifying Unused Tables in AAS Cube Over the Last 30 Days

I have a question regarding identifying unused tables in Azure Analysis Services (AAS). In our organization, we’re using AAS, and due to limited storage, our cube refresh is failing. I’ve been tasked with finding a list of tables that haven’t been used…

Azure Analysis Services
Azure Analysis Services
An Azure service that provides an enterprise-grade analytics engine.
460 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
SQL Server Reporting Services
SQL Server Reporting Services
A SQL Server technology that supports the creation, management, and delivery of both traditional, paper-oriented reports and interactive, web-based reports.
2,942 questions
asked 2024-11-07T16:03:40.6433333+00:00
madmax 0 Reputation points
edited a comment 2024-11-15T08:58:43.61+00:00
Chandra Boorla 3,230 Reputation points Microsoft Vendor
1 answer

Dataflow debug only shows 100 rows even if the query returns >100 records. Row limit is set to 1000.

Dataflow debug only shows 100 rows in the web UI in tabular format even if the query returns >100 records. Row limit is set to 1000. Is this the default behavior in azure synapse analytics? I know this is a display only behavior as I am able to join…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
asked 2024-11-14T15:57:56.0666667+00:00
Nandu S Raj 20 Reputation points
answered 2024-11-15T08:55:26.1166667+00:00
AnnuKumari-MSFT 33,476 Reputation points Microsoft Employee
0 answers

How to add expression on result of aggregate function when create Materialized View in Synapse

Hi there, When I creating materialized view in synapse, i got an error, it says "because the select list of the view contains an expression on result of aggregate function or grouping column. Consider removing expression on result of aggregate…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
asked 2024-11-12T05:57:27+00:00
zmsoft 115 Reputation points
commented 2024-11-15T06:36:21.5266667+00:00
zmsoft 115 Reputation points
1 answer

D365 F&O synchronisation table dans spark (GEN 2) , comment modifier la structure de la table

Bonjour pour des besoins d'interfaces nous avons mis en place la réplication de certaines table de D365 F&O par le biais de la power plateforme (GEN 2) qui a créé un pool Spark dans synapse mais j'ai un champs de table qui ne récupère pas la bonne…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
asked 2024-11-12T12:05:20.9866667+00:00
Admin Office 0 Reputation points
commented 2024-11-15T04:28:41.21+00:00
Chandra Boorla 3,230 Reputation points Microsoft Vendor
1 answer

Insufficient System Memory in Synapse Analytics Pipeline

Encountering issues with a Synapse Analytics Pool where the pipeline run fails with the error message: "Operation on target GetLastChangedFeedFiles failed: There is insufficient system memory in resource pool 'VDWFrontendPool' to run this…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
asked 2024-11-11T13:46:07.5766667+00:00
rajib.de@outlook.com 0 Reputation points
commented 2024-11-14T01:47:50.2866667+00:00
Chandra Boorla 3,230 Reputation points Microsoft Vendor
1 answer

Timeout error due to Error reading SSH protocol banner

Hi Team, We are facing ‘Timeout error due to Error reading SSH protocol banner’ while trying to connect to sftp server through Azure Synapse Notebook. We are using python as source language and paramiko version 2.12.0 to connect to the server and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
asked 2024-11-04T13:32:47.8733333+00:00
Abhilasha Kumar 0 Reputation points
commented 2024-11-14T01:46:14.1433333+00:00
Chandra Boorla 3,230 Reputation points Microsoft Vendor
1 answer

Retrieving schema of purview scanned assets with object type is file also,i want to retrieve the schema of assets scanned with Cosmos db as source

I could get the schema for Object type is Tables in purview, but i couldn't retrieve for the object type is files,when I am calling atlas API the schema i get is empty[].

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,680 questions
Microsoft Purview
Microsoft Purview
A Microsoft data governance service that helps manage and govern on-premises, multicloud, and software-as-a-service data. Previously known as Azure Purview.
1,231 questions
asked 2024-11-12T07:25:42.8766667+00:00
Bandi Harsha Nandini 0 Reputation points
commented 2024-11-14T01:20:11.8233333+00:00
Chandra Boorla 3,230 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

Adding a non AKV Linked Service does not modify the publish branch in Azure Synapse Analytics

I tried adding a non-AKV based linked service from a feature branch. As per MS Git troubleshoot doc for synapse, it should publish to the azure live synapse service directly, which it did, but it did not create a commit in the publish branch. The doc is…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
asked 2024-10-31T17:31:49.0666667+00:00
Nandu S Raj 20 Reputation points
commented 2024-11-13T15:50:52.9166667+00:00
Nandu S Raj 20 Reputation points
1 answer One of the answers was accepted by the question author.

Web activity is throwing an error in adf pipeline

One of the web activities in my adf pipeline is throwing an error : Error calling the endpoint 'https://acp-01-appkv.vault.azure.net'. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] The remote…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,873 questions
asked 2023-11-16T17:55:56.0766667+00:00
Ashish Jayantibhai Kadavla 25 Reputation points
commented 2024-11-13T08:48:31.6066667+00:00
ABDULLA, MAHAMMAD 21 Reputation points
1 answer One of the answers was accepted by the question author.

Unable to delete Azure Synapse Workspace even through Powershell force deletion

Hello Team, I am unable to delete synapse analytics even though following up post through webUI or powershell. I tried following the steps mentioned in the link below :-…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
PowerShell
PowerShell
A family of Microsoft task automation and configuration management frameworks consisting of a command-line shell and associated scripting language.
2,615 questions
asked 2024-11-06T21:31:49.4833333+00:00
vaddi_dataengineer 20 Reputation points
accepted 2024-11-13T00:42:26.7566667+00:00
vaddi_dataengineer 20 Reputation points
1 answer One of the answers was accepted by the question author.

Serialization Exception after changing reading from attached ADLS account to the same ADLS Account but through a linked service.

Currently we are running a Synapse Notebook that reads from the "Primary ADLS Gen2 account" and parse data to JSON. This job has been running stable for a while now. We need to run the same logic but read from a different ADLS account instead,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
asked 2024-11-08T22:49:30.5733333+00:00
Jose Gonzalez Gongora 25 Reputation points Microsoft Employee
accepted 2024-11-12T21:19:02.3533333+00:00
Jose Gonzalez Gongora 25 Reputation points Microsoft Employee
1 answer

RBAC permissions for debugging synapse data flow

Hi All. I am getting the error below when trying to debug a pipeline within Azure synapse You do not have required Synapse RBAC permission to perform this action. Contact a Synapse Administrator for this workspace. Required permission: Actions:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
asked 2024-10-24T22:22:31.36+00:00
MrFlinstone 581 Reputation points
commented 2024-11-12T14:38:55.1533333+00:00
Smaran Thoomu 17,120 Reputation points Microsoft Vendor
1 answer

How to connect to on-prem Analysis server using synapse notebook and uses System assigned managed identity as authentication.

HI Team, I have an on-prem analysis server details like server name and data base name managed by another team, they have provided access to me on the server but now is it possible to use a synapse notebook to connect to on prem analysis svr. Using…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,873 questions
asked 2024-11-07T19:16:05.7266667+00:00
farooq' s 0 Reputation points
commented 2024-11-12T12:59:03+00:00
Smaran Thoomu 17,120 Reputation points Microsoft Vendor
1 answer

Automate the activation of required tables in the Synapse Link for dataverse

Hi All, I am using Synapse Link for Dataverse for loading data from Dynamics 365 to ADLS. I have to manually activate the required tables in the Synapse link inside the dataverse, which is a pain point every time. Q1. Is there a way to automate this…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,005 questions
Microsoft Power Platform Training
Microsoft Power Platform Training
Microsoft Power Platform: An integrated set of Microsoft business intelligence services.Training: Instruction to develop new skills.
471 questions
Microsoft Dataverse Training
Microsoft Dataverse Training
Microsoft Dataverse: A Microsoft service that enables secure storage and management of data used by business apps. Previously known as Common Data Service.Training: Instruction to develop new skills.
37 questions
asked 2024-08-02T15:06:37.99+00:00
Sriram M 40 Reputation points
commented 2024-11-12T12:34:56.2466667+00:00
Dave 0 Reputation points