Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,621 questions
0 answers
What is the mechanism to implement SSL when connecting from a third party application or IPaas platforms to Azure Synapse database either in serverless sql pool or ded
How can we implement SSL between any IPass platform and Azure Synapse. Is it different when connecting to a serverless sql pool db vs dedicated sql pool db.
asked 2024-07-04T05:05:33.12+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 45%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAC%3C/text%3E%3C/svg%3E)
Amit Chakraborty
0
Reputation points
commented 2024-07-05T08:50:08.27+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 48%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
Harishga
5,590
Reputation points Microsoft Vendor
0 answers
Issues Connecting to Infor Data Lake Using Spark JDBC in Azure Synapse Spark Notebook
Hi Team, I'm encountering difficulties while attempting to connect to Infor Data Lake using Spark JDBC within Azure Synapse. Despite configuring the necessary JDBC driver and ionapi file path, I consistently encounter the following…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 15%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
5 answers
CosmosDB Analytical store delete changes in sql sink
Hi I am trying to capture delete changes from Azure cosmosdb analytical store using change data capture in Azure datafactory, Source is Cosmosdb, sink is Azure sql database. In between I am flattening my file using dataflow. My insert, update is…
asked 2024-04-30T13:52:46.2133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(112.00000000000001, 15%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKB%3C/text%3E%3C/svg%3E)
Kuldeep Bhati
0
Reputation points
commented 2024-07-05T05:56:51.36+00:00
Harishga
5,590
Reputation points Microsoft Vendor
1 answer
merge statement in 2 data frame
Hi , how to use merge statement in 2 dataframe df1=spark.sql("" sellect cole1,col2 from table1""") df2=spark.sql("" sellect cole1,col2 from table2""") expected results merge into table2 using tabl1 on…
asked 2024-07-04T19:49:06.46+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 13%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
Vineet S
265
Reputation points
answered 2024-07-04T19:57:55.45+00:00
hossein jalilian
4,695
Reputation points
1 answer
One of the answers was accepted by the question author.
Unable to use Synapse workspace features in Synapse Link for Dataverse when Synapse network is in private mode
Hi Team, We are using Synapse Link for Dataverse for syncing data from d365 to ADLS Gen2, which can be used for analytics in ADLS Gen2. As our Synapse analytics environment network is publically disabled and using…
0 answers
Azure Synapse LinkConnection template json
We have created a LinkConnection in Azure synapse, the source database is MS SQL Server and target database is Dedicated SQL Pool. We are trying to create powershell script to automate the creation of this LinkConnection for each environment - Testing,…
asked 2024-07-03T19:21:58.6166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(140.8, 53%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGP%3C/text%3E%3C/svg%3E)
Girish Prabhudesai
21
Reputation points
commented 2024-07-04T13:48:36.0433333+00:00
Girish Prabhudesai
21
Reputation points
2 answers
One of the answers was accepted by the question author.
Share a self-hosted integration runtime with Azure Synapse
Hi, I want to use the same Integration Runtime in Azure Synapse as I am currently using in existing Data Factory pipelines. I managed to grant permission to Synapse by using the "Enter Manually" option and pasting the Managed Identty Object…
asked 2020-07-20T11:15:58.977+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 13%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHO%3C/text%3E%3C/svg%3E)
Hans Olav Vogt Myklebust / Intility AS
31
Reputation points
edited a comment 2024-07-04T13:29:50.29+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 56.00000000000001%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMP%3C/text%3E%3C/svg%3E)
Militaru, Petrica
0
Reputation points
2 answers
Extracting Purchaser Data from Azure Synapse for Marketing Automation
I'm looking to connect Azure Synapse Analytics with a marketing automation platform. My goal is to identify recent purchasers from my existing Azure Synapse data and send them targeted emails using the marketing platform. While I can handle sending…
asked 2024-07-04T09:11:47.34+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 15%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV0%3C/text%3E%3C/svg%3E)
vikranth-0706
180
Reputation points
answered 2024-07-04T11:47:44.6233333+00:00
Amira Bedhiafi
18,501
Reputation points
0 answers
Synapse custom event trigger publish is not happening on event grid with master branch
Hi all, I have requirement to trigger synapse pipeline when I publish event on event grid. Without git integration when I configure the Trigger and click on publish button, subscription is appearing on Event grid and trigger is working fine. With git…
asked 2024-07-04T07:51:20.4733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 97%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMC%3C/text%3E%3C/svg%3E)
Madhu Challapalli
20
Reputation points
commented 2024-07-04T10:54:56.84+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
8,075
Reputation points Microsoft Vendor
1 answer
Error publishing notebook.
I am trying to publish my notebook. I get the following error : CreateOrUpdateNotebook failed: BadRequest. The operation failed because the entity “notebookA” is being renamed to “notebookB”. A retry of rename from exact source to target may work”. It…
asked 2024-05-30T17:31:34.6033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 14.000000000000002%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECT%3C/text%3E%3C/svg%3E)
Candy T
0
Reputation points
answered 2024-07-04T10:20:34.9733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 26%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJC%3C/text%3E%3C/svg%3E)
Jay Chandel
0
Reputation points
0 answers
Guidance on how to use Service Principal with Certificate to Authorize for EventHub Stream Read
I found this documentation https://github.com/Azure/azure-event-hubs-spark/blob/master/docs/use-aad-authentication-to-connect-eventhubs.md online on how to use service principal with certificate to use spark stream read from EventHubs, I want to do this…
asked 2024-07-01T21:27:20.97+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 28.999999999999996%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
BEPV
0
Reputation points
commented 2024-07-04T09:41:49.15+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
12,100
Reputation points Microsoft Vendor
1 answer
How to create sha256 signature for Oracle Cloud integration Rest API ?
Hi Experts, Infra: Azure Synapse -we are using pipelines / API method to get data and create a Data Warehouse. Source: We have an Oracle Cloud Infrastructure (OCI ) as source , that will output the report to Oracle Cloud Storage. OCI has a REST API…
asked 2024-07-04T03:27:38.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 41%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECA%3C/text%3E%3C/svg%3E)
Caniut Alex
0
Reputation points
answered 2024-07-04T08:41:30.3566667+00:00
Amira Bedhiafi
18,501
Reputation points
0 answers
synapse notebook
Hi , how we can add link services created in synapse in notebook available azure synapse link servicename :test2 select * from test1.table1
0 answers
After some time, viewing pipeline log links lead to wrong page
This is something I consistently experience if I use the same Synapse Analytics Workspace for a decent amount of time: My workflow is: Monitor Pipeline Runs Click on a run of interest This shows me the pipeline that ran and all the individual steps…
asked 2024-06-27T14:13:06.36+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 95%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAC%3C/text%3E%3C/svg%3E)
Andrew Chung
40
Reputation points Microsoft Employee
commented 2024-07-04T06:34:42.9133333+00:00
phemanth
8,075
Reputation points Microsoft Vendor
1 answer
Error while creating linked service from Synapse to Dyanamics 365
I am trying to create Linked Service from Microsoft Synapse to Dynamics 365. While testing connect I am getting error ClientIpAddressNotAuthorized. We have licensed Microsft Synapse and trial version of Dynamics 365.
asked 2024-07-03T06:15:50.9666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 21%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERG%3C/text%3E%3C/svg%3E)
Rakesh Gupta
0
Reputation points
commented 2024-07-04T06:09:00.6333333+00:00
Harishga
5,590
Reputation points Microsoft Vendor
1 answer
Azure Synaps serverless scan file that should be filtered
Hey, We have a large amount of files stored in Storage Account in Parquet format with the following hierarchy. /m_id=%M_ID%/quarter=%QUARTER%/month=%MONTH%/partition_version=last/part-0.parquet'. examples for quarter values: 2024Q1, 2024Q2, 2024Q3…
asked 2024-07-01T08:48:06.6533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(92.8, 11%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESL%3C/text%3E%3C/svg%3E)
Shlomi Lanton
56
Reputation points
answered 2024-07-04T05:14:39.9233333+00:00
Shlomi Lanton
56
Reputation points
1 answer
Azure synapse and reserved pricing discount
From looking at the link here https://azureaggregator.wordpress.com/2021/02/09/data-flows-in-adf-and-synapse-now-support-reserved-instance-pricing/ and …
asked 2024-07-02T14:58:46.54+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 39%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM%3C/text%3E%3C/svg%3E)
MrFlinstone
501
Reputation points
commented 2024-07-03T16:39:58.6466667+00:00
ShaikMaheer-MSFT
38,321
Reputation points Microsoft Employee
1 answer
Custom logging in Azure Synapse Datapipeline to to log analytics Workspace - Help Requested
Requirement:- Want to add custom logging in azure synapse pyspark job using python logging module and spark config Getting error while implementing the same in the pyspark job ModuleNotFoundError: No module named 'pyspark.SparkConf pyspark script for…
asked 2024-06-26T23:18:27.1633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 21%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJY%3C/text%3E%3C/svg%3E)
Johny Yagappan
20
Reputation points
answered 2024-07-03T15:55:38.49+00:00
Johny Yagappan
20
Reputation points
1 answer
One of the answers was accepted by the question author.
Do Apache Spark Pools have a Service Tag?
Our company is rolling out more restrictive network security groups and I wanted to see if we could have our Apache Spark Pools' traffic be allowed via a service tag. When I tried to trace the IP address of the pools, the IPs varied widely so a static IP…
asked 2024-06-28T15:07:17.05+00:00
Andrew Chung
40
Reputation points Microsoft Employee
accepted 2024-07-03T11:11:32.6466667+00:00
Andrew Chung
40
Reputation points Microsoft Employee
2 answers
unable to connect synapse db
Hi, Cannot connect to SQL Database. Please contact SQL server team for further support. Server: 'tcp:ag-syn-bi-group-d.sql.azuresynapse.net,1433', Database: 'bronze', User: ''. Check the linked service configuration is correct, and make sure the SQL…
asked 2024-07-02T14:07:35.56+00:00
Vineet S
265
Reputation points
commented 2024-07-03T11:08:57.7566667+00:00
Smaran Thoomu
12,100
Reputation points Microsoft Vendor