Microsoft Q&A

Azure Synapse Analytics

2,634 questions

An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.

Browse all Azure tags

2,634 questions with Azure Synapse Analytics tags

Sort by: Updated
Updated Created Answers
1 answer

Copy Data setting "Delete files after completion" leads to errors

So we've been using the copy data activity for some time now, and since last week it starts failing. We're daily copying about 10 million files from blob storage to ADLSGen2. The failure is a bit odd, it says "user error []". While doing some…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,332 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2023-02-07T16:15:00.9966667+00:00
RickMsBi 1 Reputation point
commented 2023-02-07T21:54:00.69+00:00
RickMsBi 1 Reputation point
1 answer One of the answers was accepted by the question author.

serverless SQL pool - Built-in cost

Hello, How can I find out the cost of a select query I run in the serverless sql pool? In the built-in I can see the amount of data used i.e. 10MB but not sure where to see the cost for this very select query I run? Thank you

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2021-07-27T14:55:45.753+00:00
arkiboys 7,901 Reputation points
edited the question 2023-02-07T21:52:47.74+00:00
KranthiPakala-MSFT 33,141 Reputation points Microsoft Employee
1 answer

How many partitions is needed with 90 billions table row count to benefit the CCI?

Hi, Say for example I have a large fact hash-distributed (CCI) table partitioned monthly with 90 billions table row count (current): How many partition is needed to create to benefit from a clustered columnstore index? Based from question 1, is it…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
Azure SQL Database
asked 2023-01-30T15:30:29.5666667+00:00
Anthony Marasigan 21 Reputation points
commented 2023-02-07T21:24:37.8+00:00
Oury Ba-MSFT 9,566 Reputation points Microsoft Employee
0 answers

I did not created any synapse account. I am having an error you created maximum synapse account

[…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2023-02-06T14:28:04.5133333+00:00
student_10f0d9bbldnbz8q6 0 Reputation points
commented 2023-02-07T19:53:36.2166667+00:00
BhargavaGunnam-MSFT 7,651 Reputation points Microsoft Employee
2 answers

Azure Synapse Studio not loading on Safari

Hi! I am trying to open Synapse Studio in Safari 16.1. I do not have extensions, content blockers or any other configurations on this page that may prevent it from loading. I have already cleared the cache. No error shows up, just the loading logo keeps…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2022-12-12T22:50:55.183+00:00
Mau R 6 Reputation points
commented 2023-02-07T19:33:09.64+00:00
BhargavaGunnam-MSFT 7,651 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Azure Synapse Spark pool pricing

I have one doubt about cost of spark pool in synapse. I have a spark pool with automatically pauses for 15 minutes idle, but I think it's costing more than expected. For example, If two users runs different notebooks in the same pool during 10…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2022-08-02T16:55:59.063+00:00
Robson Pelegrini 41 Reputation points
edited the question 2023-02-07T18:04:02.59+00:00
BhargavaGunnam-MSFT 7,651 Reputation points Microsoft Employee
0 answers

COPY INTO erroring out because of Polybase size limit

HdfsBridge::recordReaderFillBuffer - Unexpected error encountered filling record reader buffer: HadoopExecutionException: The size of the schema/row at ordinal 44555 is 1408314 bytes. It exceeds the maximum allowed row size of 1000000 bytes for…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2023-02-07T16:38:13.9466667+00:00
Loki 191 Reputation points
edited the question 2023-02-07T16:39:48.6233333+00:00
Loki 191 Reputation points
2 answers

Create button for dedicated sql pool is grayed out

Hi, i am taking class that requires creation of dedicated SQL pool in azure synapse, but when I go to create it, Create button is grayed out. I didn't previously create any dedicated SQL pool. Can you help?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2022-11-10T18:36:32.963+00:00
Jelena Domazet 6 Reputation points
edited the question 2023-02-07T16:37:40.88+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee
1 answer

Copy activity vs notebook which is more perfromant

I need information around the performance and cost incurred while performing copy of data from one location to another in adlsgen2 using the copy activity vs synapse notebook. Can you please recommend which will be a better approach along with details.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2022-12-02T17:42:36.993+00:00
Dheeraj Kumar Reddy Jogi 21 Reputation points Microsoft Employee
edited the question 2023-02-07T16:35:58.1433333+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee
1 answer

Is it possible to reduce the DW of a sql pool from 1000c to 750c

Is it possible to reduce the DW of a sql pool from 1000c to 750c in a sql server?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2023-01-20T08:12:24.95+00:00
Ghosh, Debashish [GTSUS NON-J&J] 0 Reputation points
commented 2023-02-07T16:18:14.2966667+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee
2 answers

Get the list of names via Get Metadata activity

Hi All, Below is the output of Get Metadata activity which contains name and type values for child items: Is it possible to just get the name values and stored within an array variable without using any iteration. Output =…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,332 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2023-02-02T12:20:22.89+00:00
Priya Jha 721 Reputation points
commented 2023-02-07T16:13:26.5033333+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee
0 answers

Netsuite integration with azure

I want to integrate netsuite with azure. There are some saved reports already in netsuite. I just want to get those reports data and load into Synapse sql. I am looking for something similar to domo- netsuite app tba connector in azure. Using this…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2022-09-26T16:54:54.187+00:00
Santhi Dhanuskodi 66 Reputation points
edited the question 2023-02-07T16:05:58.98+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee
2 answers

Best way to load from Azure SQL DB to dedicated SQL pool

I want to move data from an Azure SQL Database to Synapse. I have created a SQL Dedicated pool with the following conditions: 1) Load all the tables from the database automatically, without the need to be creating for each table a pipeline. 2) Load all…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2022-09-26T14:09:05.57+00:00
kosmos 181 Reputation points
edited the question 2023-02-07T16:05:09.16+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee
2 answers One of the answers was accepted by the question author.

create synapse workspace using arm template

I am following the below document to create my synapse workspace. but this deploys blank workspace. How can I deploy my linked services, pipelines, datasets etc using the ARM template. I know we can use Git. but I want to know how to deploy using the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2023-02-03T23:16:38.9966667+00:00
Narendra 21 Reputation points
commented 2023-02-07T15:52:01.51+00:00
Narendra 21 Reputation points
1 answer

Stored Procedure called from pieline remains in Queued status

We have few stored procedures which is being run using pipelines. It ran fine till yesterday. However from today morning the stored procedures are in Queued state.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2022-09-26T09:07:38.77+00:00
Thankappan, Avinash 1 Reputation point
edited the question 2023-02-07T15:49:52.0433333+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee
1 answer

ADF - how to remove the square bracket from json as a source.

My source is json file and target is API. This extra square bracket is failing to post in the target API. Anything to be done in mapping which I am missing ? I have created items collection using dataflow. Please help.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,332 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,218 questions
asked 2022-09-23T10:24:03.03+00:00
Anurag Yadav 1 Reputation point
edited the question 2023-02-07T15:47:29.5633333+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee
1 answer

Synapse: saveAsTable non-default database

Hi. In a Synapse notebook I'm trying to write a data frame to the Synapse database with a lake which is not set as the default. I've tried different ways of doing this, specifying the path too, but I get the same error message implying that I'm…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2022-09-22T11:25:59.317+00:00
Johan á Rogvi-Hansen 101 Reputation points Microsoft Employee
edited the question 2023-02-07T15:35:10.7833333+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee
2 answers

How to download excel file from Cloud and Save it as Excel in Azure Data Lake Store in Azure Synapse?

Anyone here to help me configure the Azure Synapse Copy Activity or any other type of activity to download excel files from a cloud storage such as Dropbox and save it as it is in ADLS? The only option I have seen and tried is to configure the Copy…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2022-09-17T02:45:37.833+00:00
Chaiwa 51 Reputation points
edited the question 2023-02-07T15:28:05.85+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee
1 answer

Data Factory/Synapse Copy data activity failing with 500 Internal Server Error. Preview data works

I am downloading a file (CSV) from API using Copy data activity and HTTP connector. Source is fine and I am able to 'Preview the data'. Sink is Blob storage using 'Binary' type. The pipeline worked onetime and everytime failing with 500 Internal…

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,332 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2022-09-12T00:23:44.473+00:00
Giri, Sun 26 Reputation points
edited the question 2023-02-07T15:11:40.66+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee
0 answers

Getting InvalidUserAssignedMiCredential when trying to deloy Synapse Artifacts

Hi, I am trying to deploy synapse artifacts. I am getting error { "ArtifactName": "DevUserAssignedMI", "ArtifactType": "Credentials", "StatusCode":…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,634 questions
asked 2022-09-08T15:20:29.617+00:00
kk 41 Reputation points
edited the question 2023-02-07T14:47:50.48+00:00
AnnuKumari-MSFT 19,121 Reputation points Microsoft Employee