SQL build fails in azure dev ops pipelines when selecting Microsoft Azure SQL Data Warehouse as the target platform in Visual Studio
SQL build fails in azure dev ops pipelines when selecting Microsoft Azure SQL Data Warehouse as the target platform in Visual Studio 2019 It succeeds when i change the target platform to Microsoft Azure SQL database, but fails when i change it to SQL…
Cannot access Azure Synapse DWH on portal, "The resource was not found" error
When I access synapse Datawarehouse on a portal the resource not found error happening. But I am still using data explorer and data factory to connect to this DWH The detailed error as below: Details The resource was not found, it may have been…
Replicated Table Distribution for Small Deployment
Microsoft design guidance suggests using a replicated distribution for small dimensions, such as date. For small service tiers, e.g., less than DW1000 where there is only one compute node allocated, does this selection still have positive impacts on…
how azure synapse on demand calculate data processed ?
for testing purpose I am using a small parquet file, it is only 1.2 MB, but I notice when I check the data processed metrics, I see numbers like 12 mb. my question is does On demand mode for Azure Synapse charge for the compressed data or uncompressed
How to setup data retention for Azure synapse analytics?
How do we delete/archive data older than certain time period in Azure synapse Analytics?
How to implement Retention Policies in Azure Synapse Analytics (Azure SQL Data Warehouse) ?
Trying to understand how to implement Retention Policies in Azure Synapse Analytics (Azure SQL Data Warehouse). There isn't enough supporting material on the steps to implement retention policies in Azure Synapse Analytics/ SQL Data Warehouse. Does…
How to pass column list as argument from databricks spark for copy write semantic
Is there a way to pass column list argument for column mapping between spark and synapse table from databricks spark for write semantics as copy as we pass it while running copy command from synapse?
How big is "Not Big Enough" for Synapse?
We are looking to move our data warehouse to the cloud. We don't have "big data". The biggest table we have has 200 millions rows. Is it cost effective to run a small data warehouse in Synapse? Is there a scenario that exists where you would…
How to insert data in Azure Synapse Analytics through Azure Data factory without PolyBase
I have tried using Move and Transfar activity in data factory but I'm getting 2 error at publishing: ' Data flow activity 'dataflow1' requires a stagingLinkedService Data flow activity 'dataflow1' requires a stagingStoragePath ' I don't want to…
Synapse updating the data lake json file?
is it possible to update the json file from synapse? After reading, i need to update the json rows. When i tried to update/delete the json through external table, it's error out with, won't support the DML operation. Kindly advise how to achieve…
Azure data lake storage Gen2 error external location not found
I used COPY INTO statement to copy csv file in ADLS Gen2 to Synapse table successfully with share access signature as credential. However, when I try to copy snappy.parquet file in the same storage account (different container) into a table in the same…
Architectual Question (ADLS, Azure Synapse, AAS, Power BI)
We are using the following: Source data stored in ADLS (Blob Storage) Azure Synapse (sort of a staging layer) Azure Analysis Services (semantic layer) Power BI (for users to create their own vizualizations based on the AAS semantic layer) …
is cetas refreshed automatically
sorry for the basic question, I just created a new CETAS (external table as a select) using azure synapse on demand, when the data source change will CETAS refresh automatically , or how to refresh a CETAS ?
Unable to load timestamp (Hexadecimal) from Azure SQL to Azure Synapse
Hi, I have been trying to load table from Azure SQL to Azure synapse (formerly Azure DW) using Azure Data Factory. However, it is failing with a timestamp column, which has hexadecimal values. Timestamp is not supported in Azure Synapse and it…
Is it possible to Read CSV files where description has a quote (not delimited by quotes) in Synapse SQL On Demand?
Hello, my question is very sample if have the following CSV file in my datalake |Id|Description |1|my description |2| descry 3 " inches is it possible to use TSQL BULK an openquery to read the above content? Thank you so much
Infer parquet schema to create table in SQL pool
hi, I am evaluating Synapse analytics (in preview) and need to create tables in Synapse sql pool from parquet files, stored in ADLS gen2. I would like to avoid creating tables manually in sql pool as my parquet files already have a schema with…
Error at create spark database in synapse workspace notebook using orchestrate pipeline.
I'm getting below error while running synapse notebook from orchestrate in synapse workbook. My notebook runs fine when ran individually from Develop. I gave Owner and Storage Blob Data Owner role to myself before running the pipeline as mentioned in…
How do we add user to synapse analytics workspace ?
Hi, How do i add AAD user to a specific Synapse Analytics Workspace. At the moment it is showing only SQL Pool Admin, Spark Admin and Workspace Admin. I want to just add end user to a workspace so that they can work with it. In Azure Databricks we…
Error while Running Predict Function in Synapse Studio
Getting an error Incorrect Syntax near 'Model' while running the Prediction function in T-SQL statement. The below query was tried on Azure Synapse Studio as well SSMS and did not work DECLARE @modelvarbinary(max) = (SELECT Model FROM…
What should I put the "Host" while linking the Oracle Service Cloud to Azure Synapse Analytics?
I want to link the Oracle Service Cloud to Azure Synapse Analytics portal, but I am not getting what should be the "Host" 12296-screenshot-65.png