5,385 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer One of the answers was accepted by the question author.

Ingesting data from Azure Synapse Analytics to Azure SQl VM database

Hi I am about to get some data in the Azure Synapse Analytics from dataverse ( via Azure Synapse link) Azure Syanpse Link can only write to Datalake or Syanpse . I have a question,. ****How data can be brought to another SQL from Azure Synapse Analytics…

SQL Server on Azure Virtual Machines
Azure SQL Database
Azure Migrate
Azure Migrate
A central hub of Azure cloud migration services and tools to discover, assess, and migrate workloads to the cloud.
930 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,662 questions
asked 2022-06-14T01:35:29.097+00:00
John K 186 Reputation points
commented 2022-06-14T06:03:06.407+00:00
Ronen Ariely 15,206 Reputation points
2 answers One of the answers was accepted by the question author.

Schema specific Admin permission for Azure Synapse

Hi, Is this possible for a Schema specific Admin permission for Azure Synapse sqlpool. Say we have 3 schemas in sqlpool. We want to add specific AD group to be the admin of a particular schema. Thanks, Anirban

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-06-10T18:31:27.837+00:00
Maitra-v, Anirban 141 Reputation points
accepted 2022-06-13T17:08:53.543+00:00
Maitra-v, Anirban 141 Reputation points
3 answers One of the answers was accepted by the question author.

Polybase - Load CSV file that contains text column with commas surrounded by quotes

I'm trying to load a CSV file using Polybase into Synapse. Here is a sample file product_id,product_name,aisle_id,department_id 1,Chocolate Sandwich Cookies,61,19 2,All-Seasons Salt,104,13 3,Robust Golden Unsweetened Oolong Tea,94,7 4,Smart Ones…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2020-10-06T13:29:07.16+00:00
satish umapathy 26 Reputation points
commented 2022-06-13T16:25:38.193+00:00
Sakthivel R 1 Reputation point
1 answer

Syanpse Pipeline Call stored procedure using SQL Pool

I'm capturing audit log for success / failure activities when moving data from parquet to sql pool db. Activities are running in parallel but few cases, there are no audit getting written to table. Pipeline shows success but still no entry in db. When I…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-06-10T12:25:01.087+00:00
Puran Joshi 1 Reputation point
commented 2022-06-13T12:05:45.937+00:00
AnnuKumari-MSFT 34,561 Reputation points Microsoft Employee Moderator
4 answers

Synapse SQL Serverless: How can I create a function that returns a single text value

Hi, I am using Synapse SQL Serverless and all I want to do is create a function that splits a string into rows using the STRING_SPLIT function and substitute those values into another string that has placeholders for those values. However, functions do…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-11-25T13:03:06.693+00:00
Sheed, Wayne 1 Reputation point
answered 2022-06-13T11:21:17.757+00:00
Anonymous
1 answer

Dedicated SQL pool

How to Load Data from ADLSGen2 to DedicatedSQlPool?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-05-31T13:12:30.883+00:00
Rachit Pandya 21 Reputation points
commented 2022-06-13T05:23:24.737+00:00
PRADEEPCHEEKATLA 90,661 Reputation points Moderator
2 answers One of the answers was accepted by the question author.

Azure Synapse Spark pool pricing

When creating a Spark pool in Azure Synapse, the pricing is per hour. Is it real time hour (include idling hours) or just computing hour (when the cores actually run)?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2020-12-01T17:15:32.097+00:00
Minh NGUYEN 126 Reputation points
commented 2022-06-13T05:07:30.527+00:00
PRADEEPCHEEKATLA 90,661 Reputation points Moderator
1 answer

SynapseML Computer Vision results as Failed to download image from input URL

Hello Team, I was following the tutorial - https://learn.microsoft.com/en-us/azure/synapse-analytics/machine-learning/tutorial-computer-vision-use-mmlspark I have my own file and below is the code %%pyspark import synapse.ml from…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-06-09T13:49:42.117+00:00
Marri, Ananda Krishna 1 Reputation point
commented 2022-06-13T05:05:39.86+00:00
PRADEEPCHEEKATLA 90,661 Reputation points Moderator
2 answers

Transaction can't be executed

I'm running a statement in Synapse and want to create a new table from a old table, rename both tables, and drop the old table in a transaction block, but it shows me the "111212;Operation cannot be performed within a transaction" error. Could…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
Developer technologies | Transact-SQL
asked 2021-11-18T13:45:54.32+00:00
Yumeng Zhang 1 Reputation point Microsoft Employee
commented 2022-06-10T15:47:37.12+00:00
Antony Taylor 1 Reputation point
2 answers

Pros/ Cons having multiple Azure SQL Data bases in same Synapse SQL pool or single SQL database for same client?

Hi All, I am going to create a new project for one of my client. Idea is to create 3 different databases like, STAGING,ENTERPRAISE and PRESENTATION DB's. Could you please assist me to go ahead with creation of these 3 diff DB's or can I create…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-06-10T11:36:06.113+00:00
Kalidas Yerravarapu 26 Reputation points
answered 2022-06-10T15:26:05.76+00:00
Kalidas Yerravarapu 26 Reputation points
3 answers

how to know the size of sql dedicated pool in synapse

I am using DW200C in my SQL dedicated pool. In my reporting side, getting data very slow and performance also not that much great. I need to know the size of Azure Synapse SQL dedicated Pool and need to check the performance imrpovement based on the…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-05-24T20:20:19.177+00:00
Kalidas Yerravarapu 26 Reputation points
answered 2022-06-10T11:07:42.99+00:00
Kalidas Yerravarapu 26 Reputation points
1 answer

Synapse Pipeline Script activty Fails after 30 mins.

Hi, I have a couple of Synapse pipelines with different Script activity to execute scripts against Synapse dedicated pool. Whenever the script runs for more than 30 mins, the activity is failing with the following error: The error message is misleading…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,662 questions
asked 2022-05-26T21:23:38.057+00:00
Kalidass Murugesan 101 Reputation points
commented 2022-06-10T10:38:11.397+00:00
AnnuKumari-MSFT 34,561 Reputation points Microsoft Employee Moderator
1 answer One of the answers was accepted by the question author.

drop table as parameters in synapse dedicated sql pool with pre-copy script using sink side of copy data activity.

I am loading data into a synapse database with the help of copy data activity, but here on the Sink side, I am auto creating tables every time. For that, I need to drop the existing table and recreate the table. For this purpose, I am using a pre-copy…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-06-08T19:07:29.387+00:00
Vaibhav B 31 Reputation points
commented 2022-06-10T10:34:31.397+00:00
AnnuKumari-MSFT 34,561 Reputation points Microsoft Employee Moderator
1 answer

Spark Synapse could not create a session

When i try to attach and run my notebook on spark cluster, it returns the error message "LivyHttpRequestFailure: Something went wrong while processing your request. Please try again later. HTTP status code: 500. Trace ID:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-06-01T12:27:08.543+00:00
Projjetta 1 Reputation point
commented 2022-06-10T10:18:51.307+00:00
AnnuKumari-MSFT 34,561 Reputation points Microsoft Employee Moderator
1 answer

Not able to view tables of dedicated SQL Pool in SSMS

I am able to see my tables in Azure synapse studio but its not visible in SQL server management studio. Though I can see data by executing queries but tables of dedicated SQL Pools not visible

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-06-04T16:16:07.227+00:00
Vikash Kumar 1 Reputation point
commented 2022-06-09T15:01:05.443+00:00
Subashri Vasudevan 11,231 Reputation points
1 answer

How to sync multiple table in bulk copy

Hi, I use bulk copy to copy entire table from SQL database into Synapse database using pipeline. Now I want to make a sync of all table so auto upsert will execute on pipeline. Thanks, Ranjeet

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-06-01T10:55:24.51+00:00
Ranjeet Mendhekar 1 Reputation point
commented 2022-06-09T13:25:32.287+00:00
AnnuKumari-MSFT 34,561 Reputation points Microsoft Employee Moderator
1 answer

Notebook fails in pipeline due to error 6002 , user error

Notebooks run fine with normal run, but when used in pipeline it fails. The reason for fail is unknown but causes of error is data write in csv. Data write is working fine normally but breaks in pipelne. all access control in security assigned to self…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-06-03T13:40:54.59+00:00
Jha, Ayush 16 Reputation points
commented 2022-06-08T20:35:18.777+00:00
KranthiPakala-MSFT 46,647 Reputation points Microsoft Employee Moderator
1 answer

Not able to create ingestion pipeline.

I am learning Azure Data Fundamentals and following the instructions given in the exercise https://learn.microsoft.com/en-us/learn/modules/examine-components-of-modern-data-warehouse/5-exercise-azure-synapse but stuck at data ingestion pipeline part. …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-06-08T07:56:23.807+00:00
Tarun Bali 1 Reputation point
commented 2022-06-08T17:09:38.773+00:00
ShaikMaheer-MSFT 38,551 Reputation points Microsoft Employee Moderator
1 answer One of the answers was accepted by the question author.

Synapse pipeline lookup activity - Select statement with where condition which compares string with '-'

In synapse pipeline I am using look up activity which reads data from Azure SQL Database. SELECT statement has WHERE condition which compares PipelineRunId. PipelineRunId Example: a3de6326-8af4-43e9-a90e-d2e123f7e6fe Below is the SELECT…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-06-08T16:16:14.18+00:00
Heta Desai 357 Reputation points
commented 2022-06-08T16:42:59.24+00:00
Heta Desai 357 Reputation points
0 answers

What is the best way to read DBF Files from Data Lake gen 2 into Synapse Analytics Notbook with Pyspark?

Hello community, we have many DBF-Files (FoxBase+/dBase III DBF) in our Data Lake gen2, that has been loaded through Synapse Pipelines. We are currently trying to find the best way to load these files with Pyspark to our Synapse Notebook and…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,563 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2022-05-31T12:28:55.437+00:00
Z.K.Z 221 Reputation points
commented 2022-06-08T14:07:59.367+00:00
Z.K.Z 221 Reputation points