Azure Analysis Services firewall is blocking access from Synapse Analytics pipeline. ADF ip ranges have been whitelisted
Hi, I'm having a hard time refreshing cubes in Azure Analysis Services from an Azure Analytics pipeline. We have the firewall enabled on AAS and supposedly all I would have to is whitelist the ip ranges for the services that need acces.I downloaded the…
Columnstore compression issue for a CTAS - Synapse SQL pool
Hi, in a DW100c Synapse dedicated SQL pool I've a hash distributed table with 260 columns and 2 millions of rows. For this table it was specified the clause CLUSTERED COLUMNSTORE INDEX. To change the hash distribution column I've used a CREATE TABLE AS…
Filtering data for last 24 months in Mapping Data Flows
How can I filter data using Mapping Data Flows for the last 24 months, starting from the max date and going back? The date column is in the mm/dd/yyyy format.
Invalid table name
I always get invalid table name when copying a query into azure. I know that it's the correct syntax, because I can query that same table from within azure itself. This occurs with all table names, so I essentially have to rewrite the entire query from…
Azure Synapse Link with F&O missing tables
Hello, I'm facing this problem with synapse link, I did: Connect F&O environment with power apps. Established an incremental link with data lake. I can see D365 Finance and Operation in the list of tables in manage tables of the link. My problem…
Query External and Dedicated Tables
Hello, I would like to know if it is feasible to use a dedicated table and an external table in the same SQL query, for example to do a join between both ? Thank you,
Minimum advised Synapse SQL pool service level to start working for a prod environment
Hi, which is the minimum Synapse service level that Microsoft advises for a dedicated SQL pool of a prod environment? Thanks
Disable support for MCD (Multi-Column Distribution) in SSDT
Hi, I'm working with a Synapse dedicated SQL pool and I'm using Visual Studio 2022 to create database projects with SSDT. I've Visual Studio 2022 vers. 17.9.2 and I need to create hash table with multi-column distribution: the related support is…
The Azure Synapse resource provider (Microsoft.Synapse) needs to be registered with the selected subscription
Hi Team, I am unable to use synapse analytics even though I have registered with Microsoft.Synapse and Microsoft.Sql. Can you please look into this? The below is screenshot for registered ones.
Multiple data source to load as single table
Hi friends, I have multiple data sources with different sections such as text and JSON and Excel, etc, and all have similar data structures. I am required to load the data in the sink as a single source of truth. I need to do this all in a single…
Advantages to use a query hint for a Synapse query
Hi, which are the advantages to use a query hint for a query in a Synapse dedicated SQL pool? Thanks
Facing issues while running multiple notebook in a single notebook via pipeline and the same notebook runs fine when it is ran without pipeline
Error data_quality { "errorCode": "6002", "message": "MagicUsageError: Cannot read notebook common_variables. The possible reason is that the notebook doesn't exist. More details please visit…
In ADF Copy Activity- Synapse Sink giving SQL DW Error : The Microsoft Distributed Transaction Coordinator (MS DTC) has cancelled the distributed transaction
When we are Copying data from ADLS to Azure Synapse Tables , we are getting following error since Friday . We are not able to write on Azure synapse from Azure pipeline Copy Activity. Below is the error. Note : Earlier it was working fine , we are…
Scheduled Pipeline failing with error - DFExecutorUserError
Curated pipeline failing occasionally with below error. Error code: DFExecutorUserError Job failed due to reason: at Sink 'DimEmployeessink': execute, tree: Exchange SinglePartition, ENSURE_REQUIREMENTS, [id=#8386] +- *(1) HashAggregate(keys=[],…
RLS on Serverless SQL Pool Views
I want to apply RLS (row-level-security) into a Serverless SQL Pool View. In this way I created a table value function to be applied in a view and when I tried to create a policy: CREATE SECURITY POLICY <policy name> ADD FILTER PREDICATE…
long creation time for concurrent sessions
I'm noticing longer Spark session creation times (over 25 minutes) for notebooks running concurrently in my pipelines. These times seem to decrease as fewer notebooks are left to execute, reaching under a minute for the final one. Could the initial delay…
Enabling auto update statistics for a Synapse dedicated SQL pool
Hi, I'd like if and when it is proper to enable the auto update statistics option for a Synapse dedicated SQL pool. Thanks
Using CTAS statement maintaining the original primary key - Synapse SQL pool
Hi, In a Synapse dedicated SQL pool is it possible to use the CREATE TABLE AS SELECT statement maintaining the original primary of the source table? Thanks
Getting error when running spark pool
Every time i run the notebook i get this error: InvalidHttpRequestToLivy: Your Spark job requested 12 vcores. However, the workspace has a 0 core limit. Try reducing the numbers of vcores requested or increasing your vcore quota. Quota can be increased…
Performance issue setting NOCOUNT to on in a stored procedure - Synapse SQL pool
Hi, I'm monitoring the execution of a stored procedure implemented in a Synapse dedicated SQL pool with DW100c service level. I've observed a run time of 15-30 milliseconds for the SET NOCOUNT ON; statement. For me, the registered time is high, really…