4,541 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

how to query trigger runs on Azure Synapse Analytics using rest api?

https://learn.microsoft.com/en-us/rest/api/datafactory/trigger-runs/query-by-factory?view=rest-datafactory-2018-06-01&tabs=HTTP I tried a similar process in Azure synapse analytics like above one. But I got an error like below. it shows object id…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-13T05:53:14.8366667+00:00
Vishnupriya N 0 Reputation points
edited the question 2024-06-13T06:01:11.7+00:00
Vishnupriya N 0 Reputation points
0 answers

Unable to deploy code into another synapse workspace where Linked Service and Integration runtime are different

Hello I have azure synapse workspace and ETL code on that workspace. I need to deploy the same code on new workspace and new subscription/tenant. I am using Synapse deployment (template and params file). I created yaml file where I can run the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-12T10:33:13.0233333+00:00
Xhevahir Mehalla 0 Reputation points
edited a comment 2024-06-13T05:44:02.4733333+00:00
Harishga 4,875 Reputation points Microsoft Vendor
1 answer

Do we need to take any action if we use "AutoResolveIntegrationRuntime" in azure synapse analytics

Azure Synapse Analytics Compute Optimized data flows will be retired on 31 August 2024 – transition to General Purpose data flows

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-11T08:23:22.0066667+00:00
Daryoush Bakhshi (UR) 0 Reputation points
commented 2024-06-13T05:17:04.94+00:00
phemanth 7,190 Reputation points Microsoft Vendor
1 answer

Dynamic Content Option for Password Field in SFTP Connector in Azure Synapse Analytics

I am working on a feature in Azure Synapse Analytics that connects to different SFTP servers dynamically based on a meta-data table. As I proceeded through it, I found out that in SFTP Linked Service, the PASSWORD field does not allow dynamic content.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,873 questions
asked 2024-06-12T17:19:45.9533333+00:00
Khushank Madaan 0 Reputation points
answered 2024-06-13T05:10:04.51+00:00
Smaran Thoomu 11,370 Reputation points Microsoft Vendor
0 answers

Changing the executor count in the Spark job definition configuration in Azure Synapse Analytics is not being reflected in the job

Hello All, Since my job was running for a long time, I did some analysis and decided to change the executor count to reduce the job running duration. My previous executor count was 4, and I tried to scale it up to 6. But the issue is, I could only…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-07T07:02:11.77+00:00
Saravana Gopal 25 Reputation points
commented 2024-06-13T04:45:04.62+00:00
Smaran Thoomu 11,370 Reputation points Microsoft Vendor
0 answers

Azure Synapse fails to load Lake Databases (500 error)

When loading a Synapse workspace, it sits at "loading resources" for awhile and eventually errors with a 500 for lake databases. The error is not particularly helpful. Any ideas on how I could potentially determine if it's a single data lake…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-11T20:11:33.8566667+00:00
Timothy Dufrane 0 Reputation points
commented 2024-06-13T04:36:22.03+00:00
Harishga 4,875 Reputation points Microsoft Vendor
1 answer

How to flatten an Array json using Azure Data Flow

I am tying to convert the following json to parquet file in azure synapse analytics, to get data from rows[]. The json response has : dimensionsheaders , metricheaders and rows, Where the dimensionsheaders and metricheaders hold the field names and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-12T22:36:49.2066667+00:00
djidji 0 Reputation points
answered 2024-06-13T00:56:24.61+00:00
Vahid Ghafarpour 19,710 Reputation points
1 answer One of the answers was accepted by the question author.

Is it possible to use Synapse link to retrieve attachments from Dataverse?

Hello, I noticed that currently Synapse link for dataverse does not sync attachments from dataverse. The only way to get attachments is to make Dataverse REST API calls. Is there a way to use synapse link to get the attachments as well ?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-11T18:26:28.22+00:00
saurabh 331 Reputation points
accepted 2024-06-12T22:47:54.89+00:00
saurabh 331 Reputation points
1 answer One of the answers was accepted by the question author.

Synchronizing a Synapse table from an on-premise Oracle table

Hi, I've a Synapse table on a dedicated SQL pool and I need to update it reading from an Oracle table. I've already implemented a Self-hosted IR and I've already read from the Oracle table rightly with the Oracle connector. The requirement from my…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,873 questions
asked 2024-06-06T15:45:42.77+00:00
pmscorca 857 Reputation points
accepted 2024-06-12T20:41:02.55+00:00
pmscorca 857 Reputation points
1 answer

ORA-12650: No common encryption or data integrity algorithm - connectivity error in Synapse.

Hi Team, We are using an Azure Self Hosted Integration Runtime to connect to an on-premise Oracle SQL Database, we had pipeline running everyday till yesterday before the west europe outage ( Ticket ID - RN9S-39Z ). Post the outage fix we have been…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-12T09:18:51.3+00:00
Jayachandran, Athul 21 Reputation points
answered 2024-06-12T09:31:55.6266667+00:00
Amira Bedhiafi 17,706 Reputation points
1 answer

Enable Managed Private EndPoint for existing synapse resource

Hi all - We're seeking to activate MPN for an existing Synapse resource, but we're unable to locate the option via the UI. Please refer to the attached screenshot. Could you kindly advise if there are any available options to enable MPN for the existing…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-05T23:47:08.88+00:00
Abhiram Duvvuru 191 Reputation points Microsoft Employee
edited a comment 2024-06-12T09:23:44.06+00:00
Harishga 4,875 Reputation points Microsoft Vendor
2 answers

I can't do multiple unroll in flatten activity synapse dataflow

It was working quite well before, And started failing with "none.get" which is no where helping me to find the root cause, Even though I figured out that multiple flatten Unroll by cause the issue. My source is multiple Nested JSON try to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-06T16:34:28.0266667+00:00
Venkatesh S 0 Reputation points
edited an answer 2024-06-12T09:12:11.4+00:00
Rahul Gosavi 86 Reputation points
0 answers

Mssparkutils.credentials.getSecretWithLS to get Certificate and create CertificateCredential in Synapse

I need to create a CertificateCredential from azure.identity, I have a PKCS12 certificate saved in a Key Vault and I am reading it using mssparkutils with LinkedService, official documentation mentioned you can create a CertificateCredential with the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-09T18:24:19.5366667+00:00
BEPV 0 Reputation points
commented 2024-06-12T08:31:01.6133333+00:00
phemanth 7,190 Reputation points Microsoft Vendor
0 answers

Apache Spark in Azure Synapse Analytics - HTTP request in notebook

Hello. I use a Notebook in Synapse where I run my Python code. I would like to make an API request from this Notebook to Microsoft Purview to send the entities. I added the pyapacheatlas library to spark. On my local computer, this code works fine…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2023-02-02T15:43:04.6233333+00:00
Dmitrii D 66 Reputation points
commented 2024-06-12T08:05:14.5366667+00:00
CB 0 Reputation points
2 answers One of the answers was accepted by the question author.

Azure Synapse studio 403 issue when public network disabled

We have created azure synapse studio with public access disabled and we have created private end points for synapse workspace with private link hub to access web synapse. but still we are getting 403 forbidden error while opening synapse web UI.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
Azure Private Link
Azure Private Link
An Azure service that provides private connectivity from a virtual network to Azure platform as a service, customer-owned, or Microsoft partner services.
480 questions
asked 2024-06-05T14:15:11.8866667+00:00
Gopisetty, Srikanth (External) 20 Reputation points
accepted 2024-06-12T07:17:48.6566667+00:00
Gopisetty, Srikanth (External) 20 Reputation points
1 answer

Federated Identity credentials auth in azure table sdk

Hi I was trying to use FIC creds for table sdk but was getting the following issue: CredentialUnavailableError: ManagedIdentityCredential authentication unavailable, no response from the IMDS endpoint. This is the doc I am following for FIC…

Azure Table Storage
Azure Table Storage
An Azure service that stores structured NoSQL data in the cloud.
162 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-05T10:15:13.1933333+00:00
SanaCMSFT-8922 301 Reputation points
edited the question 2024-06-12T07:16:07.3033333+00:00
Shweta Mathur 28,616 Reputation points Microsoft Employee
2 answers One of the answers was accepted by the question author.

Granting access to collections of objects within a workspace.

Goal: Achieve visibility and access control over pipelines, scripts, and data to the respective departments only in Azure Synapse Analytics workspace. Additional details: Data: Stored in Azure Synapse dedicated SQL pool. Description: I have data tables,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-11T08:06:33.3633333+00:00
Apurva Tiwari 20 Reputation points
accepted 2024-06-12T04:51:23.5466667+00:00
Apurva Tiwari 20 Reputation points
1 answer

Notebook fails in pipeline due to error 6002 , user error

**Notebooks function well when run normally, however they malfunction when utilized in a pipeline. The cause of the error is data write in csv, however the reason for the failure is unknown. ** Operation on target Notebook 3 failed:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-11T08:08:46.39+00:00
NANDARAJ M 0 Reputation points
commented 2024-06-12T03:50:29.18+00:00
Harishga 4,875 Reputation points Microsoft Vendor
0 answers

Error publishing notebook.

I am trying to publish my notebook. I get the following error : CreateOrUpdateNotebook failed: BadRequest. The operation failed because the entity “notebookA” is being renamed to “notebookB”. A retry of rename from exact source to target may work”. It…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-05-30T17:31:34.6033333+00:00
Candy T 0 Reputation points
commented 2024-06-11T20:40:51.78+00:00
BhargavaGunnam-MSFT 28,106 Reputation points Microsoft Employee
0 answers

Unable to deploy code to different Synapse workspace when LinkedService and ItegrationRun time are different

Hello I need help with smth and this is the current setup: Have many synapse Pipelines on subscription A I have created another subscription and workspace on another client tenant/subscription B. I created linked service and Integration Runtime on…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,541 questions
asked 2024-06-11T08:08:29.0666667+00:00
Xhevahir Mehalla 0 Reputation points
commented 2024-06-11T19:11:16.83+00:00
BhargavaGunnam-MSFT 28,106 Reputation points Microsoft Employee