Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,668 questions
2 answers
How to create Synapse Serverless SQL Pool External Table using Databricks Notebook?
Hello, Can we create Synapse Serverless SQL Pool External Table using a Databricks Notebook? E.g., the script to create an Synapse Serverless SQL Pool External Table from within Synapse is as follows: CREATE EXTERNAL TABLE [SchemaName].[TableName]…
asked 2023-07-24T20:04:56.9766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 81%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAE%3C/text%3E%3C/svg%3E)
Azure Enthusiast
10
Reputation points
edited a comment 2024-07-17T20:21:32.17+00:00
Kafran
0
Reputation points
2 answers
Failed to create Livy Session for executing notebook
Hi, I'm experiencing problems running my notebooks. The error message I get is: "Notebook execution failed at Notebook service with http status code - '200', please check the Run logs on Notebook, additional details - 'Error name - Exception, Error…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 16%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJW%3C/text%3E%3C/svg%3E)
1 answer
PySpark in Azure Synapse notebooks is very slow to do API requests
I am doing api requests in a PySpark notebook in Azure Synapse Analytics. On my local env, in a Python3 kernel, the script is going lightning fast. But in Synapse, the pyspark notebook is very very slow in doing request (like 1 in 20 seconds when i…
asked 2024-07-12T16:07:22.09+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(240, 99%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Grégoire Mansio
0
Reputation points
commented 2024-07-17T14:26:22.1333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
12,610
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Data Flow Execution Fail state=[dead]
Hi! Since last Sunday, several pipelines are failing at the data flow activities with the following error message: Yesterday I have tried to create a separate AutoResolve Integration Runtime but this does not fix it completely. I get the error with…
asked 2024-07-16T12:06:14.8233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 76%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERG%3C/text%3E%3C/svg%3E)
Rob Gouw | HBM Machines
25
Reputation points
commented 2024-07-17T13:47:01.36+00:00
Rob Gouw | HBM Machines
25
Reputation points
2 answers
How to create sha256 signature for Oracle Cloud integration Rest API ?
Hi Experts, Infra: Azure Synapse -we are using pipelines / API method to get data and create a Data Warehouse. Source: We have an Oracle Cloud Infrastructure (OCI ) as source , that will output the report to Oracle Cloud Storage. OCI has a REST API…
asked 2024-07-04T03:27:38.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 41%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECA%3C/text%3E%3C/svg%3E)
Caniut Alex
0
Reputation points
commented 2024-07-17T11:37:49.2666667+00:00
Smaran Thoomu
12,610
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Failed to create Livy Session for executing notebook
Hi, I am running notebook in microsoft fabric. All notebook activity suddenly stopped working today. Please see the error details below Notebook execution failed at Notebook service with http status code - '200', please check the Run logs on Notebook,…
asked 2024-02-28T16:03:37.9133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 94%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPS%3C/text%3E%3C/svg%3E)
Pinnaka, Sivannarayana
35
Reputation points
commented 2024-07-17T09:34:46.5333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 88%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEH%3C/text%3E%3C/svg%3E)
Erik H
15
Reputation points
1 answer
How to assign a private IP address to Synapse Analytics studio?
I am facing an issue connecting to a private SFTP server through Synapse Notebook. So, I was thinking of assigning a private IP address to synapse studio and get that IP whitelisted on SFTP server so that I can connect to it from notebook as well as…
asked 2024-07-12T15:31:48.35+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 43%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPV%3C/text%3E%3C/svg%3E)
Piyush Vijayrao Magarde
0
Reputation points
commented 2024-07-17T07:21:06.1966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
8,485
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Dataflow and copy activity upsert behavior
Hi, We are using the Azure Synapse to copy data from our datalakehouse (adls gen2 storage) to Dataverse tables. We're using the Dynamics 365 Linked service. To do this we are making use of a combination of data flows and copy steps, using 'upsert' as our…
asked 2024-07-16T06:47:47.7366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 21%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Matthew Samyn
26
Reputation points
accepted 2024-07-17T06:32:42.6033333+00:00
Matthew Samyn
26
Reputation points
0 answers
Command sp_create_sbs_file in pool SQL - Azure Synapse
Hi, We discovered last week that pool SQL from Synapse ran the query “sp_create_sbs_file” multiple times and the usual queries were not being run. I would like to know why this command executes and what actions we can take to work around the problem. I…
asked 2024-07-15T12:06:18.4+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 45%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJO%3C/text%3E%3C/svg%3E)
João Felipe Barbosa Cerqueira Carvalho
40
Reputation points
commented 2024-07-16T22:03:43.2866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
Bhargava-MSFT
28,951
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
how to read excel file data (stored in adls gen2 ) in Azure Data Factory pipeline
I have source excel file which is coming as showing in the format . Please help how to read excel file with that specified format . Please help . Thank You.
asked 2024-07-15T06:39:57.58+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 88%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBS%3C/text%3E%3C/svg%3E)
Bathini, Shirish
20
Reputation points
accepted 2024-07-16T13:58:19.0633333+00:00
Bathini, Shirish
20
Reputation points
2 answers
One of the answers was accepted by the question author.
SynapseML OpenAIChatCompletion lacks image support
OpenAIs GPT4-o model allows for an "image_url" as argument type in its Chat Completions API, but the corresponding SynapseML function seems to lack this option according to the documentation OPENAI chat completions API: response =…
asked 2024-07-02T07:26:20.9166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 41%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHG%3C/text%3E%3C/svg%3E)
Hiob Gebisso
121
Reputation points
answered 2024-07-16T13:31:37.8066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 3%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EC4%3C/text%3E%3C/svg%3E)
CusMar-4850
0
Reputation points
1 answer
Custom Logs.
I have a CSV file (say "empfile.csv") in my data lake which is then loaded into Azure Synapse's dedicated SQL pool. Now, My data exists at both Data Lake and SQL pool. Suppose, I update some field values in this data (say "Manager"…
asked 2024-07-15T08:16:44.56+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 79%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAT%3C/text%3E%3C/svg%3E)
Apurva Tiwari
40
Reputation points
commented 2024-07-16T08:55:05.3466667+00:00
AnnuKumari-MSFT
32,011
Reputation points Microsoft Employee
1 answer
Data is missing from management API using service principle. ex:resources
I have a requirement to load datasets from management.Azure.com (Management API), for example: Resources, Assessments, Tasks, and Secure Score. I have created a service principal in app registration and have been able to obtain the access token. However,…
asked 2024-07-11T22:11:50.9166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 35%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMR%3C/text%3E%3C/svg%3E)
Mahesh Reddy
0
Reputation points
commented 2024-07-16T08:06:14.98+00:00
Smaran Thoomu
12,610
Reputation points Microsoft Vendor
3 answers
SAP CDC and SAP Tables connectors regarding SAP Note 3255746 ?
Dear Team, Is there any one who when through the SAP Note 3255746 ? What impact shroud we expect regarding the SAP CDC and SAP Tables connectors already implemented for our customers? Thanks for you input. Tarik
asked 2024-04-23T11:45:42.5766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 52%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETZ%3C/text%3E%3C/svg%3E)
Tarik Zaaboul
0
Reputation points
answered 2024-07-16T06:35:48.1033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 83%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHA%3C/text%3E%3C/svg%3E)
Hasan Akhuy
0
Reputation points
1 answer
How to Interpret Dataflow costs
How to interpret 'Azure Synapse Analytics - Dataflow' consumed quantity from monthly usage report? Any scenario based examples to estimate the pricing of Azure Synapse Analytics Dataflow?
asked 2024-07-12T10:40:36.92+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 36%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA9%3C/text%3E%3C/svg%3E)
AzureUser-9588
151
Reputation points
commented 2024-07-16T05:12:53.79+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
235
Reputation points Microsoft Vendor
2 answers
Restore KekIdentity in Synapse Workspace
Hi, We deleted the managed identity for our synapse workspace that was the KekIdentity And now, when we open the workspace, none of the resources will load. I don't see any documentation on how to restore the KekIdentity for the Azure…
asked 2024-07-12T22:43:20.23+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 40%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDC%3C/text%3E%3C/svg%3E)
Dance, Cody R. (ALT)
20
Reputation points
answered 2024-07-16T04:25:03.0166667+00:00
PRADEEPCHEEKATLA-MSFT
85,121
Reputation points Microsoft Employee
1 answer
Is there an outage in UK South affecting Azure Synapse Analytics?
At around 10am (BST), our Azure Synapse Analytics pipelines started failing with the following error message: Operation on target Copy data failed: Failure happened on 'Source' side.…
asked 2024-07-10T10:15:00.4666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 78%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJN%3C/text%3E%3C/svg%3E)
James Neville
0
Reputation points
commented 2024-07-15T14:07:13.19+00:00
Bhargava-MSFT
28,951
Reputation points Microsoft Employee
2 answers
How to copy the files from private github repo to a Azure blob storage
We have incoming files in the GitHub repo and the task is to ingest these files to Azure blob using Synapse. The file ingested to Blob in a container supposes that if we have the same file of the 2 different versions, the final version should only be…
asked 2024-07-13T16:47:49.3266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 1%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Mahantha MV
0
Reputation points
answered 2024-07-15T09:06:21.2366667+00:00
Sumarigo-MSFT
45,406
Reputation points Microsoft Employee
2 answers
This request is not authorized to perform this operation using this permission.", 403, HEAD Synapse connect to adls
I am trying to select data from ADLS Gen2 storage delta table and keep receiving this error. I added the synapse service principal as storage blob data contributor and ACLs to container with no luck. Firewall is set to enable all networks as well. Please…
asked 2024-06-22T20:29:54.0233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 87%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDW%3C/text%3E%3C/svg%3E)
Daniel Woodhouse
0
Reputation points
commented 2024-07-15T07:32:42.4733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(150.4, 64%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENR%3C/text%3E%3C/svg%3E)
Nehruji R
4,451
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
Missing ODBC drivers on spark 3.3 & 3.4 version
Hi Team - We are upgrading our Spark version from 3.2 to 3.4 and using the pyodbc module for SQL operations. However, we are encountering the following error when attempting to connect to the Azure SQL Database. Could someone please assist…
asked 2024-07-05T20:55:19.18+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(160, 73%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAD%3C/text%3E%3C/svg%3E)
Abhiram Duvvuru
231
Reputation points Microsoft Employee
commented 2024-07-15T04:19:19.77+00:00
PRADEEPCHEEKATLA-MSFT
85,121
Reputation points Microsoft Employee