Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,395 questions
0 answers
Synapse Scala | Read Cosmos DB Container data using managed identity
Hi Team, I tried reading Cosmos data using Managed Identity inside a Synapse Scala notebook, but it's not working as expected. Already provided access for synapse workspace by using below command New-AzCosmosDBSqlRoleAssignment -ResourceGroupName…
asked 2024-05-01T14:01:16.22+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 14.000000000000002%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
AJITH KUMAR RAI
0
Reputation points
edited a comment 2024-05-04T06:18:12.7666667+00:00
AJITH KUMAR RAI
0
Reputation points
6 answers
Error trying to validate storage account name while creating a new synapse workspace
I am unable to create a new data lake storage (gen2) account name in the basic tab for create Azure Synapse Workspace. The error I get is - " There was an error trying to validate storage account name. please try again ". The error message is…
asked 2022-08-03T07:01:54.587+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 2%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
Jozure
446
Reputation points
commented 2024-05-04T05:39:05.8733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 54%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAH%3C/text%3E%3C/svg%3E)
Ahmed Helal
0
Reputation points
0 answers
Pass value from an array selectively to For Each
Hi, I have a parent pipeline that captures values in an array - ArrayFullLoadData. Currently ArrayFullLoadData have three values [A,B,C] and the same is passed to a ForEach with @pipeline.parameters.ArrayFullLoadData. Inside ForEach, values A, B,C are…
asked 2024-05-03T19:53:04.3366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 51%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKA%3C/text%3E%3C/svg%3E)
Kumar, Arun
296
Reputation points
asked 2024-05-03T19:53:04.3366667+00:00
Kumar, Arun
296
Reputation points
1 answer
Linked services and Key Vault
Hello, Just a question regarding link services, basically, our orgnisation has linked services with one datasbases from different business area, now we need to ingest data from different source, ideally from sharepoint with all the csv files for other…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(112.00000000000001, 2%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENW%3C/text%3E%3C/svg%3E)
2 answers
Can you assist with a Synapse issue involving memory allocation in SQL DW Copy Command in Data Factory, without solely resorting to increasing DWU?
I'm encountering an issue while using the Copy Activity in Data Factory with the Polybase copy option. The error message I receive is as follows: “…..SQL DW Copy Command operation failed with error 'Unable to allocate 257707 KB for columnstore…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(25.6, 40%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EE%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 48%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
2 answers
Backup/Restore and collation update in Azure Synapse
We have one requirement that to change the collation of Azure SQL serverless database in Azure Synapse Analytics to default collation. So I have 2 questions, 1. How to take backup and restore Azure SQL serverless database in synapse. 2. How to update…
asked 2024-04-30T14:04:23.77+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(83.2, 64%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
Shailesh Ganesh Shripati
70
Reputation points
commented 2024-05-03T12:05:08.6366667+00:00
Shailesh Ganesh Shripati
70
Reputation points
1 answer
Access Azure SQL DBs using Azure Synapse studio
I would like to understand how Azure Synapse Analytics can be used within the organization to facilitate data analysis and development. How will developers access Azure Datasets in a convenient way Is there a case for using Azure Synapse? I have a use…
asked 2024-04-22T08:25:56.1866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(19.2, 54%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESD%3C/text%3E%3C/svg%3E)
Santhi Dhanuskodi
145
Reputation points
edited a comment 2024-05-03T11:57:56.9433333+00:00
Santhi Dhanuskodi
145
Reputation points
1 answer
Long queue time for copy activity in synapse pipeline
This Synapse Analytics pipeline runs a simple SQL script that joins a table with its change table and outputs the results (less than 100 rows) as a parquet file in Azure Data Lake Storage Gen2. A Copy activity with the SQL script as a source and Storage…
asked 2024-05-03T09:43:08.2566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(41.6, 5%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV2%3C/text%3E%3C/svg%3E)
Vikranth-2626
120
Reputation points
answered 2024-05-03T11:21:52.9133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
9,760
Reputation points Microsoft Vendor
1 answer
ADF Copy Activity : Data load from ADLS (parquet files) to Azure Synapse Table Failing after running for 24 hours
ADF pipeline copy failed after running for 24 hours. Timeout is set to 7days. Copy Activity is trying to copy data from ADLS (Parquet files) to Azure Synapse Table on Production Environment . Could you please suggest what could be the possible issue for…
asked 2024-05-02T08:48:59.7533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 24%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKS%3C/text%3E%3C/svg%3E)
Kapoor, Sipra (S)
5
Reputation points
commented 2024-05-03T10:13:53.3866667+00:00
Smaran Thoomu
9,760
Reputation points Microsoft Vendor
0 answers
Synapse workspace deployment node-js supported versions
Hi, I would like to know the list of node.js versions supported for Synapse workspace deployment (Synapse Workspace Deployment@2 task). I can't seem to find any documentation describing the same.
asked 2024-05-02T13:33:01.2333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 45%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERK%3C/text%3E%3C/svg%3E)
Raghul Kannan
106
Reputation points
commented 2024-05-03T10:12:59.69+00:00
Smaran Thoomu
9,760
Reputation points Microsoft Vendor
1 answer
Synapse Pipeline Error: Bad Request
Hello, We occasionally encounter the following error during the execution of several of our pipelines in Azure Synapse Analytics: { "errorCode": "BadRequest", "message": "The request failed with status code…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 9%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZK%3C/text%3E%3C/svg%3E)
0 answers
How to parse nested json array of document in ADF data flow
Hi all I am trying to fitch the values from a nested josh array of document , I have used aggregate to convert into objects but not able to fitch the values of all child nodes like as below itOffer.item itOffer.item.SplOfr itOffer.item.buy …
asked 2024-05-02T15:44:57.8633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 6%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVR%3C/text%3E%3C/svg%3E)
venkat rao
45
Reputation points
edited a comment 2024-05-03T08:34:54.1733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
5,840
Reputation points Microsoft Vendor
1 answer
Configuring sql user permission to INSERT only via stored procedure in Synapse dedicated pool
We currently have a client with External users set up via AAD and each group has access to a certain schema with grant permission to select, insert, delete and update on their dedicated SQL pool. Our client would like to revoke explicit insert, delete…
asked 2024-05-02T10:09:36.33+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 68%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Marjan Selahi
0
Reputation points
commented 2024-05-03T08:33:17.45+00:00
Marjan Selahi
0
Reputation points
1 answer
Azure Synapse Analytics Workspace And its Dedicated SQL Pool Migration From one subscription to another subscription during Cross Subscription Migration
I just Want to know that how can I migrate synapse workspace and its dedicated SQL pool from one subscription to another subscription during cross subscription migration
asked 2024-05-02T13:20:37.0333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 66%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMA%3C/text%3E%3C/svg%3E)
Maaz Ahmed Nagori
0
Reputation points
commented 2024-05-03T07:42:52.1266667+00:00
Smaran Thoomu
9,760
Reputation points Microsoft Vendor
0 answers
How can we connect Blackboard DDA (a SaaS using PostgreSQL to store data ) via Azure Synapse analytics using SSL certificate for authentication in SHIR for Private Vnet enabled networks.
Blackboard DDA is a SaaS application which uses PostgreSQL as DB to store data. The DB uses a SSL certificate key to authenticate and we have private Vnet enabled. How to create a linked service for this DB and where do we store certificate in SHIR. Are…
asked 2024-05-03T05:41:52.49+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 47%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDJ%3C/text%3E%3C/svg%3E)
Dravya Jain
0
Reputation points
asked 2024-05-03T05:41:52.49+00:00
Dravya Jain
0
Reputation points
0 answers
auto table join
Hi Team, once we pull the 2 table to synapse... is there any way it will automatically joined with primary and foreign keys like we see in power BI
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 13%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
1 answer
InvalidHttpRequestToLivy: Your Spark job requested 12 vcores. However, the workspace has a 0 core limit.
it gives me this error and when i tried to increase core size limit i could not find that option so how to solve this error?
asked 2024-05-02T20:01:34.8666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 88%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJM%3C/text%3E%3C/svg%3E)
Janvi Majmundar
0
Reputation points
edited an answer 2024-05-02T21:45:49.03+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
26,306
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Send large amount of data to external systems
Hi friends, we have a requirement to send a large amount of data in gigabytes from Azure to third-party external systems. The data needs to be sent to both azure and API public endpoint methods. How to send this securely without latency? What are the…
asked 2024-04-29T10:54:01.7433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 15%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anshal
1,886
Reputation points
edited a comment 2024-05-02T15:55:18.41+00:00
Amira Bedhiafi
15,676
Reputation points
1 answer
One of the answers was accepted by the question author.
Synapse workspace deployment node-js error ERR_INVALID_ARG_TYPE
Hi I am working on a CI/CD DevOps pipeline for Synapse Analytics. The Synapse workspace is integrated in my git repo, and I want to use task 'Synapse Workspace Deployment' with operation 'validate' to generate the ARM templates. The task is configured as…
asked 2023-11-27T12:05:22.12+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 54%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Simon Plancke
25
Reputation points
commented 2024-05-02T13:29:48.66+00:00
Raghul Kannan
106
Reputation points
4 answers
One of the answers was accepted by the question author.
Error occurred when deserializing source JSON file
I am doing 'Copy Data' from my Vendor's API to ADLS Gen2 CSV sink. The endpoint works in Postman, and returns Content-Type as text/plain;charset=ISO-8859-1 I checked with my API vendor, there is no JSON output offered. I configured the REST…
asked 2023-09-25T20:35:42.38+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(284.8, 63%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDS%3C/text%3E%3C/svg%3E)
Dheepak Sreedharan
20
Reputation points
answered 2024-05-02T12:31:26.43+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 38%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EK%3C/text%3E%3C/svg%3E)
Kwitaro
0
Reputation points