4,213 questions with Azure Synapse Analytics tags

Sort by: Updated
2 answers

Azure Analysis Services firewall is blocking access from Synapse Analytics pipeline. ADF ip ranges have been whitelisted

Hi, I'm having a hard time refreshing cubes in Azure Analysis Services from an Azure Analytics pipeline. We have the firewall enabled on AAS and supposedly all I would have to is whitelist the ip ranges for the services that need acces.I downloaded the…

Azure Analysis Services
Azure Analysis Services
An Azure service that provides an enterprise-grade analytics engine.
431 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-15T10:11:04.41+00:00
Roel Evers 21 Reputation points
answered 2024-03-19T10:17:55.82+00:00
Roel Evers 21 Reputation points
1 answer

Columnstore compression issue for a CTAS - Synapse SQL pool

Hi, in a DW100c Synapse dedicated SQL pool I've a hash distributed table with 260 columns and 2 millions of rows. For this table it was specified the clause CLUSTERED COLUMNSTORE INDEX. To change the hash distribution column I've used a CREATE TABLE AS…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-17T18:54:19.5933333+00:00
pmscorca 692 Reputation points
answered 2024-03-19T10:00:11.2966667+00:00
Amira Bedhiafi 12,791 Reputation points
1 answer

Filtering data for last 24 months in Mapping Data Flows

How can I filter data using Mapping Data Flows for the last 24 months, starting from the max date and going back? The date column is in the mm/dd/yyyy format.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,307 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,267 questions
asked 2024-03-19T01:29:58.9966667+00:00
ADITYA SINGH 0 Reputation points
answered 2024-03-19T09:38:06.6366667+00:00
Amira Bedhiafi 12,791 Reputation points
0 answers

Invalid table name

I always get invalid table name when copying a query into azure. I know that it's the correct syntax, because I can query that same table from within azure itself. This occurs with all table names, so I essentially have to rewrite the entire query from…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-12T16:02:23.9433333+00:00
Jake Watson 0 Reputation points
edited a comment 2024-03-19T09:26:13.45+00:00
phemanth 4,450 Reputation points Microsoft Vendor
0 answers

Azure Synapse Link with F&O missing tables

Hello, I'm facing this problem with synapse link, I did: Connect F&O environment with power apps. Established an incremental link with data lake. I can see D365 Finance and Operation in the list of tables in manage tables of the link. My problem…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,307 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-19T08:57:53.9533333+00:00
Ameer Jaber 0 Reputation points
2 answers

Query External and Dedicated Tables

Hello, I would like to know if it is feasible to use a dedicated table and an external table in the same SQL query, for example to do a join between both ? Thank you,

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-18T13:26:24.0933333+00:00
Wajih Arfaoui 65 Reputation points
commented 2024-03-19T08:25:44.5933333+00:00
Wajih Arfaoui 65 Reputation points
1 answer

Minimum advised Synapse SQL pool service level to start working for a prod environment

Hi, which is the minimum Synapse service level that Microsoft advises for a dedicated SQL pool of a prod environment? Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-18T12:29:34.72+00:00
pmscorca 692 Reputation points
commented 2024-03-19T08:24:16.0466667+00:00
Harishga 2,550 Reputation points Microsoft Vendor
1 answer

Disable support for MCD (Multi-Column Distribution) in SSDT

Hi, I'm working with a Synapse dedicated SQL pool and I'm using Visual Studio 2022 to create database projects with SSDT. I've Visual Studio 2022 vers. 17.9.2 and I need to create hash table with multi-column distribution: the related support is…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
Visual Studio
Visual Studio
A family of Microsoft suites of integrated development tools for building applications for Windows, the web and mobile devices.
4,483 questions
asked 2024-03-17T06:39:45.5333333+00:00
pmscorca 692 Reputation points
commented 2024-03-19T08:20:28.75+00:00
Harishga 2,550 Reputation points Microsoft Vendor
1 answer

The Azure Synapse resource provider (Microsoft.Synapse) needs to be registered with the selected subscription

Hi Team, I am unable to use synapse analytics even though I have registered with Microsoft.Synapse and Microsoft.Sql. Can you please look into this? The below is screenshot for registered ones.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-17T20:59:34.6633333+00:00
Srini v 0 Reputation points
commented 2024-03-19T07:45:24.04+00:00
PRADEEPCHEEKATLA-MSFT 74,641 Reputation points Microsoft Employee
1 answer

Multiple data source to load as single table

Hi friends, I have multiple data sources with different sections such as text and JSON and Excel, etc, and all have similar data structures. I am required to load the data in the sink as a single source of truth. I need to do this all in a single…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,267 questions
asked 2024-03-17T10:56:50.5933333+00:00
Anshal 1,586 Reputation points
commented 2024-03-19T07:45:14.4733333+00:00
PRADEEPCHEEKATLA-MSFT 74,641 Reputation points Microsoft Employee
1 answer

Advantages to use a query hint for a Synapse query

Hi, which are the advantages to use a query hint for a query in a Synapse dedicated SQL pool? Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-16T17:33:46.44+00:00
pmscorca 692 Reputation points
commented 2024-03-19T06:23:53.1266667+00:00
Smaran Thoomu 7,695 Reputation points Microsoft Vendor
0 answers

Facing issues while running multiple notebook in a single notebook via pipeline and the same notebook runs fine when it is ran without pipeline

Error data_quality { "errorCode": "6002", "message": "MagicUsageError: Cannot read notebook common_variables. The possible reason is that the notebook doesn't exist. More details please visit…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-18T14:27:44.7866667+00:00
Abhinesh Kumar Lal Karn 0 Reputation points
commented 2024-03-19T06:02:57.6+00:00
Harishga 2,550 Reputation points Microsoft Vendor
0 answers

In ADF Copy Activity- Synapse Sink giving SQL DW Error : The Microsoft Distributed Transaction Coordinator (MS DTC) has cancelled the distributed transaction

When we are Copying data from ADLS to Azure Synapse Tables , we are getting following error since Friday . We are not able to write on Azure synapse from Azure pipeline Copy Activity. Below is the error.  Note : Earlier it was working fine , we are…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,267 questions
asked 2024-03-18T07:52:06.1533333+00:00
Kapoor, Sipra (S) 0 Reputation points
commented 2024-03-19T04:20:14.3733333+00:00
Kapoor, Sipra (S) 0 Reputation points
0 answers

Scheduled Pipeline failing with error - DFExecutorUserError

Curated pipeline failing occasionally with below error. Error code: DFExecutorUserError Job failed due to reason: at Sink 'DimEmployeessink': execute, tree: Exchange SinglePartition, ENSURE_REQUIREMENTS, [id=#8386] +- *(1) HashAggregate(keys=[],…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-11T15:11:17.7266667+00:00
Yalamanchili, Praveen 0 Reputation points
commented 2024-03-18T21:19:59.2833333+00:00
BhargavaGunnam-MSFT 24,726 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

RLS on Serverless SQL Pool Views

I want to apply RLS (row-level-security) into a Serverless SQL Pool View. In this way I created a table value function to be applied in a view and when I tried to create a policy: CREATE SECURITY POLICY <policy name> ADD FILTER PREDICATE…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-15T19:41:01.7433333+00:00
Renato de Melo 65 Reputation points
accepted 2024-03-18T20:13:35.9066667+00:00
Renato de Melo 65 Reputation points
1 answer One of the answers was accepted by the question author.

long creation time for concurrent sessions

I'm noticing longer Spark session creation times (over 25 minutes) for notebooks running concurrently in my pipelines. These times seem to decrease as fewer notebooks are left to execute, reaching under a minute for the final one. Could the initial delay…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-15T05:28:07.3533333+00:00
HideyoshiAkaio 240 Reputation points
accepted 2024-03-18T17:27:31.7566667+00:00
HideyoshiAkaio 240 Reputation points
2 answers

Enabling auto update statistics for a Synapse dedicated SQL pool

Hi, I'd like if and when it is proper to enable the auto update statistics option for a Synapse dedicated SQL pool. Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-16T16:36:10.9533333+00:00
pmscorca 692 Reputation points
commented 2024-03-18T15:04:29.9066667+00:00
Azar 16,315 Reputation points
1 answer

Using CTAS statement maintaining the original primary key - Synapse SQL pool

Hi, In a Synapse dedicated SQL pool is it possible to use the CREATE TABLE AS SELECT statement maintaining the original primary of the source table? Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-16T17:24:39.61+00:00
pmscorca 692 Reputation points
commented 2024-03-18T15:04:24.95+00:00
Azar 16,315 Reputation points
1 answer One of the answers was accepted by the question author.

Getting error when running spark pool

Every time i run the notebook i get this error: InvalidHttpRequestToLivy: Your Spark job requested 12 vcores. However, the workspace has a 0 core limit. Try reducing the numbers of vcores requested or increasing your vcore quota. Quota can be increased…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-02-22T20:28:08.0866667+00:00
Abhishek Ramamurthy 45 Reputation points
accepted 2024-03-18T14:22:48.47+00:00
Abhishek Ramamurthy 45 Reputation points
2 answers One of the answers was accepted by the question author.

Performance issue setting NOCOUNT to on in a stored procedure - Synapse SQL pool

Hi, I'm monitoring the execution of a stored procedure implemented in a Synapse dedicated SQL pool with DW100c service level. I've observed a run time of 15-30 milliseconds for the SET NOCOUNT ON; statement. For me, the registered time is high, really…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,213 questions
asked 2024-03-16T17:11:02.1166667+00:00
pmscorca 692 Reputation points
accepted 2024-03-18T14:11:28.0066667+00:00
pmscorca 692 Reputation points