Content
ADF Data Flows, HadoopSqlException: Arithmetic overflow error converting expression to data type NVARCHAR at sink
Hello, I got the following error message thrown by a pipeline containing a data flow activity. Operation on target df_stg_json_to_synapse_seedesadv failed: {"StatusCode":"DFExecutorUserError","Message":"Job failed due…


Certificate Not Received
Hi Team, I successfully completed my DP-203 certification on 5 Feb with Registration ID: 441390759. However, I have not received the certificate for the same. Could you please help to check on this? Thanks,


COPY INTO erroring out because of Polybase size limit
HdfsBridge::recordReaderFillBuffer - Unexpected error encountered filling record reader buffer: HadoopExecutionException: The size of the schema/row at ordinal 44555 is 1408314 bytes. It exceeds the maximum allowed row size of 1000000 bytes for…
Question about a best practice inside Azure DevOps for Azure Synapse
Hi there, I've one question about a best practice inside Azure DevOps for Azure Synapse, this is for make the CI part of the CICD, I've followed this link:…


Difference in firing event based triggers with same setup
Team, Today I have see some weird behavior where one trigger is running late than the other one where as both has the same setup. We have created two event based triggers to fire based on a blob created in ADLS Gen 2. One will trigger the serverless to…


What does Synapse Commit Unit mean
Hello, I want to evaluate Azure Synapse Link to see whether it is the right tool for our task. But I can't find any good explanations about the pricing model. I see a table of costs of Synapse Commit Units, but there are no explanations about what that…


Can not use pydantic objects in UDF
When trying to use a pydantic object inside a UDF, I get the following error message; PicklingError: Can't pickle <cyfunction int_validator at 0x7f1aa626dc70>: it's not the same object as pydantic.validators.int_validator I use the following code…


Retirve more than 1000 records
Hi, I am accessing successfactor API to get employee data and pass parameter like AbsoluteUrl=$['@__next'] but its not working


This is about table creation in synapse's dedicated sql pool.
This is about table creation in synapse's dedicated sql pool. Regarding the role of the primary key in synapse's dedicated sql pool, it is stated that "PRIMARY KEY is only supported when both NONCLUSTERED and NOT ENFORCED are in use." The…


Error Message "SMTPAuthenticationError",how to correct the python code??
Use python to send email ,but display error message "SMTPAuthenticationError", how to correct the python code?? *p.s. sender's mail will not from Gmail...


Pagination of REST API call with "Link" in Header and rel="next"
Hello, I have a hard time doing pagination in ADF dataflow activity. Tried many of the below, nothing worked. My Link in Header is like below - Any idea how to work on it?


Spark Table using CSV - Line Separator
I'm trying to create a Spark table using a CSV as source. The CSV file has row delimiter of \r\n, however, the last field in the file is returning a \r when an empty string. According to documentation, \r\n should be handled by default lineSep…


Dynamic load balance
We have a Synapse Data Factory process that dynamically kicks off >200 extracts. As Data Factory has a 20 pipeline running concurrently limit, the remaining extracts are queued behind the initial 20 However, it appears to be evenly queuing the…


Synapse showplan_xml error
If I use synapse via SSMS, i get the error "The statement Batch is currently not supported with set showplan_xml on" if I declare variables. This is not happening for hard coded values. Is there any reason for this behavior?


Copy Data setting "Delete files after completion" leads to errors
So we've been using the copy data activity for some time now, and since last week it starts failing. We're daily copying about 10 million files from blob storage to ADLSGen2. The failure is a bit odd, it says "user error []". While doing some…


serverless SQL pool - Built-in cost
Hello, How can I find out the cost of a select query I run in the serverless sql pool? In the built-in I can see the amount of data used i.e. 10MB but not sure where to see the cost for this very select query I run? Thank you


How many partitions is needed with 90 billions table row count to benefit the CCI?
Hi, Say for example I have a large fact hash-distributed (CCI) table partitioned monthly with 90 billions table row count (current): How many partition is needed to create to benefit from a clustered columnstore index? Based from question 1, is it…




Azure Synapse Studio not loading on Safari
Hi! I am trying to open Synapse Studio in Safari 16.1. I do not have extensions, content blockers or any other configurations on this page that may prevent it from loading. I have already cleared the cache. No error shows up, just the loading logo keeps…


Azure Synapse Spark pool pricing
I have one doubt about cost of spark pool in synapse. I have a spark pool with automatically pauses for 15 minutes idle, but I think it's costing more than expected. For example, If two users runs different notebooks in the same pool during 10…

