Content
How to use linked service in Notebook with pyspark
I have pyspark script in Notebook to read and write data in ADLS Gen2. Below is an sample of the pyspark script. But in the Synapse I only have a linked service created with Service Principle could connect to the ADLS Gen2, so I need to specify in…


Azure Synapse Analytics - Serverless SQL Pool - Queries Considerably Slow Down When Running Concurrently
I'm mostly new to the world of "big data", but have a good enough understanding of how data lakes, SQL pools, etc work and how they come together. However, I've setup an Azure Data Lake Gen2 storage account, being queried by an Azure Serverless…


Error with SSIS OLE DB Connection to Azure synapse serverless pool
Hello Microsoft Support Community, I am looking to pull data from a view in a serverless SQL pool in an azure synapse workspace. To connect to and preview the data, I am using an on-prem SSIS package with an OLE DB connection manager. I am able to…


How do I configure Azure Cognitive Search datasource to connect using service principal?
I am moving from SQL server to Synapse and need to connect my data source in Cognitive Search using a service principal. I do not see an option for this. Is it possible?


Can you give us some more details on how to do this?
Can you give us some more details on how to do this? https://learn.microsoft.com/ja-jp/azure/data-factory/data-flow-lookup#analyzing-matched-rows


How do you resolve errors in variable contents?
Please let me know how to solve this. I know what the cause is, but I can't think of a way to fix it. The activity structure of synapsen is the image and JSON shown above. The pipeline and data structure and JSON code are as shown in the URL below. …


How to set a maximum limit of spending on azure
Hello, I need your help to understand how I can set a maximum budget limit on my azure account. For example, let's say I don't want to spend more than 200 dollar per month how can I set that? thank you


Synapse - UserAccounts
On Azure Synapse, We want to control using the workload management by using resource limitations. Can we use something like OAUTH token for multiple teams instead of having multiple accounts to trace the usage and queries?
is it possible to query a data lake with a dedicated sql pool in Azure like you can with a serverless sql pool?
is it possible to query a data lake with a dedicated sql pool in Azure like you can with a serverless sql pool?


getting error - Sqlcmd: Error: Microsoft ODBC Driver 17 for SQL Server : Setting QUOTED_IDENTIFIER to 'OFF' is not supported..
when trying to execute procedure in synapse dedicated pool from local command prompt as attached and getting error as - Sqlcmd: Error: Microsoft ODBC Driver 17 for SQL Server : Setting QUOTED_IDENTIFIER to 'OFF' is not supported.. Is this related to any…


How to best mimic system versioned tables in Synapse Dedicated Pool when migrating from Azure SQL Server?
We are looking to migrate a database from Azure SQL Server to Synapse Dedicated pool. We use system-versioned tables (aka Temporal tables) in Azure SQL Server. Synapse Dedicated Pools do not support system versioned tables out of the box it seems. Any…


Copy Dataverse data from ADLS Gen2 to Azure SQL DB leveraging Azure Synapse Link template in Synapse not working for multiple entities
Hi, While using a Template related to Copy data from Dataverse to SQL via Azure Synapse link, templates while configuring for multiple entities are not working. Issues I was facing After configuring Dataflows, pipelines are working successfully, but…




rowcount from parquet file in synapse pipeline
HI - I need to know the row count from parquet file in synapse pipeline. I am trying with lookup activity but it has some limitation in keeping the rows in memory and throws an error if the data size exceeds 1MB(?). Is there any better way to find it…


How do I view the Dedicated pool as a Azure SQL DB
Hi, I have a Stream analytics job. I need to bring one reference input from a Synapse dedicated pool. Can I view or configure the dedicated pool as a Azure SQL DB so that I can bring the data in my ASA job (as the ASA only allows Azure SQL DB). Thanks…


Nested Execute Pipeline issue in ADF master pipeline
Hi ,In my case i have a master pipeline which has nested Execute pipelines like execute1 pipeline contains lookup and foreach inside foreach execute2 .inside execute 2 get metadata and and foreach again inside foreach execute3 .execute3 contains lookup…


ServiceBus_CDMToSynapseView' was unable to start
I am deploying the components to read the csv and metadata files landing the azure datalake from the Dynamics 365 finance and Opertions system that create tables in the synapse server. I can see the folder and files in the blob storage container. I…


azure synapse incremental pipeline duplicates at sink
Hello, I have built a simple incremental pipeline that helps me extract each file name and takes the latestfile and does a simple upsert with expression true(). I noticed the sync table comes in with duplicate values and I made sure my sink skips…


Dynamics 365 FO CDMUtilSolution no tables appear in synapse
I am deploying the components to read the csv and metadata files landing the azure datalake from the Dynamics 365 finance and Opertions system. I can see the folder and files in the blob storage container. I deployed the CDM App in Azure, using the…


Copy Activity goes into Internal Server 500 error for rest identity.
Hello, I am using copy activity and selecting rest_identity for call data from different API. I made a main and micro pipeline. The main pipeline consists of calling the token which is being passed to several micro pipeline. Out of 5 micro-pipeline,…

