ADF in Azure Synapse Analytics Workspace: Trigger Now gives error message "Sync and publish your changes before clicking "Trigger now"."
We have a simple ADF developed in Azure Synapse Analytics Workspace. Running it via "Debug" works fine. Running it via "Trigger Now" gives the error message Sync and publish your changes before clicking "Trigger now". …
Synapse spark logs
Hello, Is there a possibility to get access to Spark logs in Synapse other than through Spark UI? I've tried specifying "properties.defaultSparkLogFolder" when creating spark pools but it does not seem to have any effect - what is it used…
Synapse query failed after 6 minutes from Data factory
Hi, I'm using the copy activity to extract data from Synapse analytics (SQL DWH). After exactly 6:38 minutes the query fails and the error is a Timeout Error. If a run the query from ssms, works. I set up the max time for query timeout: …
Synapse workspace - Error code: ClientIpAddressNotAuthorized Inner error code: ClientIpAddressNotAuthorized
Getting this error when trying to save a notebook in Synapse workspace Error code: ClientIpAddressNotAuthorized Inner error code: ClientIpAddressNotAuthorized I can access synapse DB from SSMS and from browser based - Query editor. Any…
Synapse Studio Access control - "Add" button disables
Hello, I'm trying to add a service principal as a Synapse Contributor, but when I go to Manage -> Access Control in Synapse Studio "Add" button is disabled. The user I'm logged in with is Synapse Administrator. Are there any additional…
query to specific partition in synapse?
In oracle, to query the particular partition we use following partition keyword i.e SELECT * FROM employees PARTITION (p1); is there any similar command in azure synapse, to query the particular partition in partition table? Also how to identify in…
Update-AzSynapseSqlPool suspend or resume not working
Hi, I have installed the Az.Synapse module Install-Module -Name Az.Synapse I have connection to the Synapse Workspace and sqlpool Test-AzSynapseSqlPool -WorkspaceName "synws-futurefdw-devtest" -Name sqlpool True Now I want to…
Solutioning without ADLS
I am planning to ingest source tables without using ADLS. I do not have any file analytics requirement, just intend to load the source to Synapse and top of that to build dimensional model. Do you see any disadvantage/risk here as I am planning to…
Error Code "6001"
I am running a Synapse Notebook through a synapse pipeline and am getting an error code 6001 "Creating new Synapse Notebook Statement Failed" and haven't been able to find anything explaining why. When running the code manually, it runs…
Does TR support between On-premise SQL Server and Azure Synapse #5925
Does Microsoft support Transactional Replication between On-premise SQL Server and Azure Synapse?
urgent - synapse partition table no performance difference?
one of synapse table we've 300 million rows and keep increasing. Every row as status column i.e active_row either 0 or 1. Active_row is int datatype. Users only query based active_row = 1 which has only 28 million row and rest of data i.e 270 million is…
ADF load empty strings as null using Polybase
{ "name": " ", "properties": { "activities": [ { "name": " ", "type": "Copy", "dependsOn": [], "policy": { "timeout":…
Is it possible to replicate data from an Azure SQL Managed Instance database to an Azure Synapse database?
We are considering using Azure SQL managed instance for our OLTP applications and Azure Synapse for analytical applications. For some operational reporting use cases, we need copy of data from OLTP databases inside Azure Synapse. For these scenarios, …
User with contributor role on Resource group can't query on Synapse Studio
Hello, ...and thanks in advance. I've just joined some users to a resource group that includes a Synapse workspace. I've added them as contributors in the whole resource group and they can access to the Synapse Studio but they has no access to…
How to convert LOTS and LOTS of log data stored in JSON format in Azure Data Lake (Gen2) to parquet files?
I have tens of thousands of devices in the field that store their logs to a centralized Azure Data Lake Gen 2 BLOB storage. The data is JSON format. The data is actually very flat, not a lot of nested arrays, etc. It could almost be a CSV format just…
Fastest way to load data from SQL server to Azure synapse
what's the fastest way to load data from SQL Server to Azure synapse .... suppose the SQL Server is on-prem... Data factory , using SQL Server as Source and Azure synapse as sink will give a best performance ?? or need to SQL Server -> to a…
How to add .so file to a sys.path directory?
Hi, I would like to add a .so file to one of the sys.path directories. I have attempted to use shutil to copy over from adls, but shutil doesn't recognise this path. Any ideas? Thanks
Access Azure Storage account via Synapse through Managed Identity
I am trying to connect to Azure Blob storage via Azure synapse through Managed Identity based on the below set of steps: 1) Assigned an Identity to the Server 2) Gave access to the Server on Blob storage as contributor 3) Executed the below queries …
![](https://techprofile.blob.core.windows.net/images/nU6nYqttiUqkasJ2PMYbbQ.png?8DB643)
How to migrate Dedicatel SQL Pool (DW) to Serveless Synapse?
I have Azure Datawarehouse which has fixed pricing tier DW100. Usage is small and assuming that Serverless can be cheaper. A) How do get information how much data processing have been occururing in last month? B) How to do migration to Serverless?