Microsoft Q&A

Azure Synapse Analytics

2,639 questions

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

Browse all Azure tags

2,639 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

ADF Data Flows, HadoopSqlException: Arithmetic overflow error converting expression to data type NVARCHAR at sink

Hello, I got the following error message thrown by a pipeline containing a data flow activity. Operation on target df_stg_json_to_synapse_seedesadv failed: {"StatusCode":"DFExecutorUserError","Message":"Job failed due…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,341 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2021-03-25T17:59:57.153+00:00
STAKV 36 Reputation points
commented 2023-02-08T13:11:54.13+00:00
Theodora Eleftheriou 0 Reputation points
0 answers

Certificate Not Received

Hi Team, I successfully completed my DP-203 certification on 5 Feb with Registration ID: 441390759. However, I have not received the certificate for the same. Could you please help to check on this? Thanks,

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-02-08T11:45:15.8633333+00:00
Varinder Singh 0 Reputation points
1 answer

COPY INTO erroring out because of Polybase size limit

HdfsBridge::recordReaderFillBuffer - Unexpected error encountered filling record reader buffer: HadoopExecutionException: The size of the schema/row at ordinal 44555 is 1408314 bytes. It exceeds the maximum allowed row size of 1000000 bytes for…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-02-07T16:38:13.9466667+00:00
Loki 191 Reputation points
answered 2023-02-08T10:34:17.5166667+00:00
Loki 191 Reputation points
1 answer

Question about a best practice inside Azure DevOps for Azure Synapse

Hi there, I've one question about a best practice inside Azure DevOps for Azure Synapse, this is for make the CI part of the CICD, I've followed this link:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-02-07T14:02:36.44+00:00
Jonathan Sus 0 Reputation points
edited an answer 2023-02-08T10:25:53.98+00:00
ShaikMaheer-MSFT 28,261 Reputation points Microsoft Employee
0 answers

Difference in firing event based triggers with same setup

Team, Today I have see some weird behavior where one trigger is running late than the other one where as both has the same setup. We have created two event based triggers to fire based on a blob created in ADLS Gen 2. One will trigger the serverless to…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,341 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-02-08T10:19:32.2433333+00:00
Jakeer Shaik 86 Reputation points
0 answers

What does Synapse Commit Unit mean

Hello, I want to evaluate Azure Synapse Link to see whether it is the right tool for our task. But I can't find any good explanations about the pricing model. I see a table of costs of Synapse Commit Units, but there are no explanations about what that…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-02-07T14:04:00.3266667+00:00
Anton Chernetskiy 0 Reputation points
edited a comment 2023-02-08T09:49:25.0633333+00:00
AnnuKumari-MSFT 19,276 Reputation points Microsoft Employee
0 answers

Can not use pydantic objects in UDF

When trying to use a pydantic object inside a UDF, I get the following error message; PicklingError: Can't pickle <cyfunction int_validator at 0x7f1aa626dc70>: it's not the same object as pydantic.validators.int_validator I use the following code…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,220 questions
asked 2023-02-08T08:59:45.3666667+00:00
Freia Vercruysse 21 Reputation points
1 answer

Retirve more than 1000 records

Hi, I am accessing successfactor API to get employee data and pass parameter like AbsoluteUrl=$['@__next'] but its not working

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2021-04-07T13:39:04.493+00:00
Umesh Chape 1 Reputation point
answered 2023-02-08T08:28:38.58+00:00
Olga Dontsova 0 Reputation points
1 answer

This is about table creation in synapse's dedicated sql pool.

This is about table creation in synapse's dedicated sql pool. Regarding the role of the primary key in synapse's dedicated sql pool, it is stated that "PRIMARY KEY is only supported when both NONCLUSTERED and NOT ENFORCED are in use." The…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-02-08T05:14:36.4666667+00:00
ponponpon 481 Reputation points
answered 2023-02-08T06:30:31.6+00:00
Nandan Hegde 21,631 Reputation points
1 answer

Error Message "SMTPAuthenticationError",how to correct the python code??

Use python to send email ,but display error message "SMTPAuthenticationError", how to correct the python code?? *p.s. sender's mail will not from Gmail...

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-02-08T03:45:22.1733333+00:00
Erwin 6 Reputation points
answered 2023-02-08T06:08:27.53+00:00
Arun Siripuram 661 Reputation points
0 answers

Pagination of REST API call with "Link" in Header and rel="next"

Hello, I have a hard time doing pagination in ADF dataflow activity. Tried many of the below, nothing worked. My Link in Header is like below - Any idea how to work on it?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,341 questions
asked 2023-02-02T01:11:52.59+00:00
Kumar, Arun 21 Reputation points
commented 2023-02-08T05:02:26.22+00:00
MartinJaffer-MSFT 24,091 Reputation points Microsoft Employee
0 answers

Spark Table using CSV - Line Separator

I'm trying to create a Spark table using a CSV as source. The CSV file has row delimiter of \r\n, however, the last field in the file is returning a \r when an empty string. According to documentation, \r\n should be handled by default lineSep…

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,220 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-02-08T04:45:54.5633333+00:00
Ryan Abbey 1,061 Reputation points
0 answers

Dynamic load balance

We have a Synapse Data Factory process that dynamically kicks off >200 extracts. As Data Factory has a 20 pipeline running concurrently limit, the remaining extracts are queued behind the initial 20 However, it appears to be evenly queuing the…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,341 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-01-26T23:05:01.87+00:00
Ryan Abbey 1,061 Reputation points
commented 2023-02-08T04:16:59.84+00:00
Ryan Abbey 1,061 Reputation points
0 answers

Synapse showplan_xml error

If I use synapse via SSMS, i get the error "The statement Batch is currently not supported with set showplan_xml on" if I declare variables. This is not happening for hard coded values. Is there any reason for this behavior?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-02-03T23:09:56.2266667+00:00
Narendra 41 Reputation points
commented 2023-02-08T02:25:00.2233333+00:00
BhargavaGunnam-MSFT 7,651 Reputation points Microsoft Employee
1 answer

Copy Data setting "Delete files after completion" leads to errors

So we've been using the copy data activity for some time now, and since last week it starts failing. We're daily copying about 10 million files from blob storage to ADLSGen2. The failure is a bit odd, it says "user error []". While doing some…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,341 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-02-07T16:15:00.9966667+00:00
RickMsBi 1 Reputation point
commented 2023-02-08T01:40:30.9633333+00:00
Nasreen Akter 10,601 Reputation points
1 answer One of the answers was accepted by the question author.

serverless SQL pool - Built-in cost

Hello, How can I find out the cost of a select query I run in the serverless sql pool? In the built-in I can see the amount of data used i.e. 10MB but not sure where to see the cost for this very select query I run? Thank you

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2021-07-27T14:55:45.753+00:00
arkiboys 7,901 Reputation points
edited the question 2023-02-07T21:52:47.74+00:00
KranthiPakala-MSFT 33,146 Reputation points Microsoft Employee
1 answer

How many partitions is needed with 90 billions table row count to benefit the CCI?

Hi, Say for example I have a large fact hash-distributed (CCI) table partitioned monthly with 90 billions table row count (current): How many partition is needed to create to benefit from a clustered columnstore index? Based from question 1, is it…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
Azure SQL Database
asked 2023-01-30T15:30:29.5666667+00:00
Anthony Marasigan 21 Reputation points
commented 2023-02-07T21:24:37.8+00:00
Oury Ba-MSFT 9,566 Reputation points Microsoft Employee
0 answers

I did not created any synapse account. I am having an error you created maximum synapse account

[…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2023-02-06T14:28:04.5133333+00:00
student_10f0d9bbldnbz8q6 0 Reputation points
commented 2023-02-07T19:53:36.2166667+00:00
BhargavaGunnam-MSFT 7,651 Reputation points Microsoft Employee
2 answers

Azure Synapse Studio not loading on Safari

Hi! I am trying to open Synapse Studio in Safari 16.1. I do not have extensions, content blockers or any other configurations on this page that may prevent it from loading. I have already cleared the cache. No error shows up, just the loading logo keeps…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2022-12-12T22:50:55.183+00:00
Mau R 6 Reputation points
commented 2023-02-07T19:33:09.64+00:00
BhargavaGunnam-MSFT 7,651 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Azure Synapse Spark pool pricing

I have one doubt about cost of spark pool in synapse. I have a spark pool with automatically pauses for 15 minutes idle, but I think it's costing more than expected. For example, If two users runs different notebooks in the same pool during 10…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,639 questions
asked 2022-08-02T16:55:59.063+00:00
Robson Pelegrini 41 Reputation points
edited the question 2023-02-07T18:04:02.59+00:00
BhargavaGunnam-MSFT 7,651 Reputation points Microsoft Employee