Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,975 questions
1 answer
No more allocated vCores on Azure For Students Subscription
Hello, I got an azure for students subscription a week ago and Azure Synapse Spark Pool worked just fine with the allocated 12 vCores that come with the subcription. I only used 2$ of credit as of now, but for some reason, since yesterday, new created…
asked 2024-10-31T20:23:37.7666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 1%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERB%3C/text%3E%3C/svg%3E)
Ramzi Belbahri
0
Reputation points
commented 2024-11-04T00:40:16.0266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
2,525
Reputation points Microsoft Vendor
1 answer
trying to write data from adlsgen2 to synapse sql dedicated pool but getting data type error
I am trying to write data into a table from adls gen2 using a copy activity. when creating the table, i have to use varchar(max). varchar(8000) is not an option as my data is too big for that. when creating the table using dedicated sql pool, i am able…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 39%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESA%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
ADF is billing high
We are in the middle of the development of an Azure project using ADF and other Azure services. The trigger scheduled and event base are used profusely by my colleagues as part of testing and it is causing billing issues. My question is does only…
asked 2024-11-02T16:54:32.6233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 88%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
azure_learner
320
Reputation points
commented 2024-11-03T14:27:10.3433333+00:00
azure_learner
320
Reputation points
1 answer
Using System-Assigned Managed Identity for Blob Storage Access in Azure Synapse Analytics
Hello guys! I'm working on a project in Azure Synapse Analytics and want to switch from using a connection string to a system-assigned managed identity for accessing Blob Storage. I’ve enabled the managed identity and assigned the appropriate role, but…
asked 2024-10-28T12:13:39.88+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 13%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVJ%3C/text%3E%3C/svg%3E)
Vinit Joshi
5
Reputation points
edited the question 2024-11-03T06:25:50.55+00:00
Sumarigo-MSFT
46,441
Reputation points Microsoft Employee
1 answer
Integration runtime is failing
Hi Team, we are unable to run the pipeline using Microsoft Integration Runtime and see following errors. |DEBUG: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown. at …
asked 2024-10-30T13:49:45.89+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 55.00000000000001%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERA%3C/text%3E%3C/svg%3E)
Riyaz Ahmed Khaja Hussain
0
Reputation points
commented 2024-11-02T04:47:18.93+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
16,640
Reputation points Microsoft Vendor
1 answer
Adding a non AKV Linked Service does not modify the publish branch in Azure Synapse Analytics
I tried adding a non-AKV based linked service from a feature branch. As per MS Git troubleshoot doc for synapse, it should publish to the azure live synapse service directly, which it did, but it did not create a commit in the publish branch. The doc is…
asked 2024-10-31T17:31:49.0666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 86%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENS%3C/text%3E%3C/svg%3E)
Nandu S Raj
0
Reputation points
commented 2024-11-01T21:14:30.9033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
945
Reputation points Microsoft Vendor
1 answer
Is the Azure notebookutils python package available to on a local development system?
We are developing a python application to run in Azure Synapse. We want to use mssparkutils, which is part of the notebooktuils package. It doesn't appear that notebookutils is available in the pypi index to be downloaded locally. Is it available…
asked 2022-07-29T13:52:11.97+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 30%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJA%3C/text%3E%3C/svg%3E)
Jarrett Anderson
21
Reputation points
commented 2024-11-01T20:56:39.23+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 62%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENL%3C/text%3E%3C/svg%3E)
Nick Lucero
0
Reputation points
3 answers
Missing Records in Azure Log Analytics
Hi All, Logs of activities, pipelines, and triggers are gathered within the Synapse environment for monitoring purposes. It has been observed that some pipelines ran successfully, as seen in the Monitor section of Synapse, but there are missing records…
asked 2024-10-21T13:55:53.4933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 54%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJP%3C/text%3E%3C/svg%3E)
Jakub Pytlik
0
Reputation points
commented 2024-11-01T20:39:42.9233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 20%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPR%3C/text%3E%3C/svg%3E)
Pranay Reddy Madireddy
365
Reputation points Microsoft Vendor
0 answers
automate adding library to spark pool and automate Apache Spark configuration
Our team is trying to do two things 1. automate adding spark-mssql-connector JAR file while the spark pool is creating, not via the UI in synapse workspace automate Apache Spark configuration while the spark pool is creating, not via the UI in…
asked 2024-10-29T17:53:24.9833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 97%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECC%3C/text%3E%3C/svg%3E)
Chelsea Chen
0
Reputation points Microsoft Employee
commented 2024-11-01T15:29:02.09+00:00
Chandra Boorla
2,525
Reputation points Microsoft Vendor
1 answer
How to check a parquet file version in synapse?
Hi, I tried to copy a parquet file to csv format in gen2 by using copy activity, but failed. It shows the following error: { "errorCode": "2200", "message":…
asked 2024-10-30T18:00:06.6333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 32%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZY%3C/text%3E%3C/svg%3E)
Zhu, Yueli YZ [NC]
235
Reputation points
commented 2024-11-01T12:26:45.62+00:00
Chandra Boorla
2,525
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Whether the Stream Analytics service supports modifying the row records of the output target database
Hi there, I now have a scenario where I receive data from EventHub through the Azure Stream Analytics service and UPDATE the data into the Azure Synapse table, now I know INSERT is supported, but I don't know if Update is supported. How to update…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 53%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZ%3C/text%3E%3C/svg%3E)
1 answer
COPY Activity shows longer duration but its actually less. Which is true?
Hi @Anonymous I have noticed in one of our COPY Activity which shows start date and end date duration as 3 min 30 s but when I dig down deep inside for an activity which took 2 minutes but its actually just 19 seconds where does the remaining 1 min 41…
asked 2024-10-28T12:04:39.9233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 97%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ET0%3C/text%3E%3C/svg%3E)
TheNerd-0042
50
Reputation points
commented 2024-11-01T08:47:08.39+00:00
Chandra Boorla
2,525
Reputation points Microsoft Vendor
1 answer
Notebook : AccessDeniedException
Hello, I am trying to save a delta/parquet file into the ADLS Gen2 using a PySpark Notebook as follows : delta_output_path =…
asked 2024-10-29T15:28:46.6966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 90%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EWA%3C/text%3E%3C/svg%3E)
Wajih Arfaoui
70
Reputation points
commented 2024-11-01T07:02:24.2333333+00:00
Smaran Thoomu
16,640
Reputation points Microsoft Vendor
2 answers
How to save complete web activity output to ADLS Gen2 in JSON format? Azure Synapse Studio
I want to save the output of my Web activity (which hits an Api and then fetches data from that Api in Json format) into blob storage account container. Also, my web activity is within a foreach - so multiple Api links are being hit and multiple files…
asked 2024-10-24T05:42:30.79+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(185.6, 20%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Mitashi Malkani
0
Reputation points
commented 2024-11-01T07:01:02.5866667+00:00
Chandra Boorla
2,525
Reputation points Microsoft Vendor
1 answer
Automating activity management in synapse data warehouse ETL
We are currently building a Data Warehouse on Synapse using ETL processes. We’re looking for a way to automate the stopping and starting of activities in the event of issues or during deployments, as the current manual method of enabling and disabling…
asked 2024-10-29T11:27:56.0433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 15%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EG2%3C/text%3E%3C/svg%3E)
Gabriel-2005
285
Reputation points
commented 2024-11-01T06:00:03.98+00:00
Smaran Thoomu
16,640
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
How to copy all tables of a Schema to .csv file format in respective folders
Hi, I am trying to copy all tables of Schema-SALES from SQL Server to .csv file format in ADF and files of each table must copy in respetive folder for example. source (SQL SERVER Tables) SALES.Customer SALES. Address …
asked 2023-12-22T21:18:17.5066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 10%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZH%3C/text%3E%3C/svg%3E)
Zaeemul Haque
25
Reputation points
commented 2024-10-31T15:21:02.04+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 84%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EWX%3C/text%3E%3C/svg%3E)
Wenrong Xu
0
Reputation points
2 answers
Role Assignment "New-AzRoleAssignment" for Azure Blob Storage is failing using powershell script
Below is my scenario for which I have created a power shell task in Azure DevOps pipeline Scenario= I am trying to query the files from ADLS blob storage in azure synapse workspace. To do this I need to grant "Storage Blob Data Reader" Role…
asked 2022-11-11T05:50:24.527+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 0%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
sachin gupta
376
Reputation points
answered 2024-10-31T14:13:22.8233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 41%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EK%3C/text%3E%3C/svg%3E)
Killerbe
50
Reputation points
1 answer
Data flow sink file name enumeration with LPAD function
Hi, when using a data flow to move data from one container to another and specify the output file names, I am able to get my files enumerated in the style of FileName1.csv, FileName2.csv...but I am not able to get this working with an lpad function.…
asked 2024-10-25T15:25:58.4433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(169.60000000000002, 14.000000000000002%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERG%3C/text%3E%3C/svg%3E)
ROWE, GENEVIEVE
0
Reputation points
commented 2024-10-31T10:32:18.7633333+00:00
Vinodh247
22,871
Reputation points
1 answer
How to Use System-Assigned Managed Identity for Secure Access to Blob Storage in Synapse Notebook?
Hello Community, I'm currently working on a project in Azure Synapse Analytics and would like to enhance the security of my data access. My Python code in the Synapse notebook currently accesses Blob Storage using a connection string, but I want to…
asked 2024-10-28T11:53:36.3733333+00:00
Vaibhav Patil
235
Reputation points
commented 2024-10-30T20:30:00.6366667+00:00
Chandra Boorla
2,525
Reputation points Microsoft Vendor
1 answer
Why does a COPY Activity shows that it took long time in duration, but when we check the sub-tasks it has actually taken less time
Hi Team, I have a scenario here where a COPY Activity shows that it took long time as per start and end time of the pipeline, but when I check the sub-tasks it has actually taken less time than it is being shown as time taken. Which is true here? If the…
asked 2024-10-28T11:53:29.73+00:00
TheNerd-0042
50
Reputation points
commented 2024-10-30T20:29:43.12+00:00
Chandra Boorla
2,525
Reputation points Microsoft Vendor