Microsoft Q&A

Azure Synapse Analytics

2,639 questions

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

Browse all Azure tags

Filter

Content

No answers or comments

With accepted answer

882

2,639 questions with Azure Synapse Analytics tags

0 answers

ADF Data Flows, HadoopSqlException: Arithmetic overflow error converting expression to data type NVARCHAR at sink

Hello, I got the following error message thrown by a pipeline containing a data flow activity. Operation on target df_stg_json_to_synapse_seedesadv failed: {"StatusCode":"DFExecutorUserError","Message":"Job failed due…

asked

STAKV 36

commented

Theodora Eleftheriou 0

0 answers

Certificate Not Received

Hi Team, I successfully completed my DP-203 certification on 5 Feb with Registration ID: 441390759. However, I have not received the certificate for the same. Could you please help to check on this? Thanks,

asked

Varinder Singh 0

1 answer

COPY INTO erroring out because of Polybase size limit

HdfsBridge::recordReaderFillBuffer - Unexpected error encountered filling record reader buffer: HadoopExecutionException: The size of the schema/row at ordinal 44555 is 1408314 bytes. It exceeds the maximum allowed row size of 1000000 bytes for…

asked

Loki 191

answered

Loki 191

1 answer

Question about a best practice inside Azure DevOps for Azure Synapse

Hi there, I've one question about a best practice inside Azure DevOps for Azure Synapse, this is for make the CI part of the CICD, I've followed this link:…

asked

Jonathan Sus 0

edited an answer

ShaikMaheer-MSFT 28,261 Microsoft Employee

0 answers

Difference in firing event based triggers with same setup

Team, Today I have see some weird behavior where one trigger is running late than the other one where as both has the same setup. We have created two event based triggers to fire based on a blob created in ADLS Gen 2. One will trigger the serverless to…

asked

Jakeer Shaik 86

0 answers

What does Synapse Commit Unit mean

Hello, I want to evaluate Azure Synapse Link to see whether it is the right tool for our task. But I can't find any good explanations about the pricing model. I see a table of costs of Synapse Commit Units, but there are no explanations about what that…

asked

Anton Chernetskiy 0

edited a comment

AnnuKumari-MSFT 19,276 Microsoft Employee

0 answers

Can not use pydantic objects in UDF

When trying to use a pydantic object inside a UDF, I get the following error message; PicklingError: Can't pickle <cyfunction int_validator at 0x7f1aa626dc70>: it's not the same object as pydantic.validators.int_validator I use the following code…

asked

Freia Vercruysse 21

1 answer

Retirve more than 1000 records

Hi, I am accessing successfactor API to get employee data and pass parameter like AbsoluteUrl=$['@__next'] but its not working

asked

Umesh Chape 1

answered

Olga Dontsova 0

1 answer

This is about table creation in synapse's dedicated sql pool.

This is about table creation in synapse's dedicated sql pool. Regarding the role of the primary key in synapse's dedicated sql pool, it is stated that "PRIMARY KEY is only supported when both NONCLUSTERED and NOT ENFORCED are in use." The…

asked

ponponpon 481

answered

Nandan Hegde 21,631

1 answer

Error Message "SMTPAuthenticationError"，how to correct the python code??

Use python to send email ，but display error message "SMTPAuthenticationError"， how to correct the python code?? *p.s. sender's mail will not from Gmail...

asked

Erwin 6

answered

Arun Siripuram 661

0 answers

Pagination of REST API call with "Link" in Header and rel="next"

Hello, I have a hard time doing pagination in ADF dataflow activity. Tried many of the below, nothing worked. My Link in Header is like below - Any idea how to work on it?

asked

Kumar, Arun 21

commented

MartinJaffer-MSFT 24,091 Microsoft Employee

0 answers

Spark Table using CSV - Line Separator

I'm trying to create a Spark table using a CSV as source. The CSV file has row delimiter of \r\n, however, the last field in the file is returning a \r when an empty string. According to documentation, \r\n should be handled by default lineSep…

asked

Ryan Abbey 1,061

0 answers

Dynamic load balance

We have a Synapse Data Factory process that dynamically kicks off >200 extracts. As Data Factory has a 20 pipeline running concurrently limit, the remaining extracts are queued behind the initial 20 However, it appears to be evenly queuing the…

asked

Ryan Abbey 1,061

commented

Ryan Abbey 1,061

0 answers

Synapse showplan_xml error

If I use synapse via SSMS, i get the error "The statement Batch is currently not supported with set showplan_xml on" if I declare variables. This is not happening for hard coded values. Is there any reason for this behavior?

asked

Narendra 41

commented

BhargavaGunnam-MSFT 7,651 Microsoft Employee

1 answer

Copy Data setting "Delete files after completion" leads to errors

So we've been using the copy data activity for some time now, and since last week it starts failing. We're daily copying about 10 million files from blob storage to ADLSGen2. The failure is a bit odd, it says "user error []". While doing some…

asked

RickMsBi 1

commented

Nasreen Akter 10,601

1 answer

serverless SQL pool - Built-in cost

Hello, How can I find out the cost of a select query I run in the serverless sql pool? In the built-in I can see the amount of data used i.e. 10MB but not sure where to see the cost for this very select query I run? Thank you

asked

arkiboys 7,901

edited the question

KranthiPakala-MSFT 33,146 Microsoft Employee

1 answer

How many partitions is needed with 90 billions table row count to benefit the CCI?

Hi, Say for example I have a large fact hash-distributed (CCI) table partitioned monthly with 90 billions table row count (current): How many partition is needed to create to benefit from a clustered columnstore index? Based from question 1, is it…

asked

Anthony Marasigan 21

commented

Oury Ba-MSFT 9,566 Microsoft Employee

0 answers

I did not created any synapse account. I am having an error you created maximum synapse account

[…

asked

student_10f0d9bbldnbz8q6 0

commented

BhargavaGunnam-MSFT 7,651 Microsoft Employee

2 answers

Azure Synapse Studio not loading on Safari

Hi! I am trying to open Synapse Studio in Safari 16.1. I do not have extensions, content blockers or any other configurations on this page that may prevent it from loading. I have already cleared the cache. No error shows up, just the loading logo keeps…

asked

Mau R 6

commented

BhargavaGunnam-MSFT 7,651 Microsoft Employee

1 answer

Azure Synapse Spark pool pricing

I have one doubt about cost of spark pool in synapse. I have a spark pool with automatically pauses for 15 minutes idle, but I think it's costing more than expected. For example, If two users runs different notebooks in the same pool during 10…

asked

Robson Pelegrini 41

edited the question

BhargavaGunnam-MSFT 7,651 Microsoft Employee