5,385 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

How to export Databricks dataframe(Pandas or Scala) to Synapse analyitcs SQL table using Active Directory Password

Hi Team, I am new to the Azure, I need your expertise in Moving Dataframe from Databricks to Synapse Analytics table. We have implemented a classification model in Databricks and predicted the values and created the dataframe with Actual and predicted…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,551 questions
asked 2021-07-09T09:59:44.493+00:00
Pradeep Thotakura 1 Reputation point
commented 2021-07-27T10:55:57.483+00:00
PRADEEPCHEEKATLA 90,661 Reputation points Moderator
1 answer One of the answers was accepted by the question author.

ADLS TO HIVE TABLES CREATION

Folder contains both csv and parquet files in ADLS....how to create the hive tables in azure synapse analytics

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-18T09:39:00.727+00:00
Sandhya A 21 Reputation points
accepted 2021-07-27T05:45:09.303+00:00
Sandhya A 21 Reputation points
1 answer

Is it possible to create Data Models in Synapse using Views which are in a database(Dedicated or Serverless) ?

By Data Model , I mean linking n number of tables/views based on their common columns. And also , if the data model is created , implement Row Level Security and Column Level Security on it.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-16T05:06:23.023+00:00
sachink 86 Reputation points
commented 2021-07-26T22:32:50.523+00:00
KranthiPakala-MSFT 46,647 Reputation points Microsoft Employee Moderator
1 answer One of the answers was accepted by the question author.

Synapse security

Hello, I would like to write a few paragraphs on the synapse security for the benefit of the Architecture/Engineering team. For example, which parts of the security that synapse offers are benefited by which team. Can you please let me know which…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-24T07:05:53.737+00:00
arkiboys 9,706 Reputation points
accepted 2021-07-26T06:11:13.127+00:00
arkiboys 9,706 Reputation points
2 answers

Move Azure DWH from the serverless tier to the provisioned tier

Hi folks! The official doc is quite poor regarding the topic info. Here is an instruction: Onboarding into serverless compute tier …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-17T19:50:52.67+00:00
Vadim K 21 Reputation points
commented 2021-07-23T16:48:04.457+00:00
MartinJaffer-MSFT 26,156 Reputation points
1 answer

Help escaping with External File Format

I'm trying to create an external file format to create an external table off of a csv file with a simplified example row shown below consisting of three string fields (the last being html): foo,bar,"<div…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-21T21:40:12.36+00:00
Hochmanj 101 Reputation points
commented 2021-07-23T06:04:01.937+00:00
MartinJaffer-MSFT 26,156 Reputation points
1 answer

Communications link failure error in Synapse dataflow: com.mysql.cj.jdbc.exceptions.CommunicationsException

I'm getting a connection error in a Synapse dataflow while trying to debug or test source connection to an integration dataset linked to an Azure MySQL database. The MySQL server is working elsewhere and copy operations on the integration…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
Azure Database for MySQL
Azure Database for MySQL
An Azure managed MySQL database service for app development and deployment.
999 questions
asked 2021-07-20T08:29:26.363+00:00
Yorozuya 1 Reputation point
answered 2021-07-22T22:36:57.6+00:00
Saurabh Sharma 23,851 Reputation points Microsoft Employee Moderator
1 answer

SSL Certificate error Synapse Analytics

Hi, when trying to read an excel file from ADLS Gen2 with synapse notebook and pandas i recieve the following error: URLError : <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:852)> Traceback (most recent call…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
Developer technologies | .NET | Other
asked 2021-03-02T09:25:08.287+00:00
holmaq 1 Reputation point
answered 2021-07-22T01:47:00.117+00:00
Chandana Basani 1 Reputation point Microsoft Employee
1 answer One of the answers was accepted by the question author.

Scala Synapse notebook dataframe.write.mode("append") Not working

I am trying to write spark sql table to Sql data warehouse. I am able to create a table from scratch but if I try to append the data to existing DW table, it fails. Here is code: *df.createOrReplaceTempView("vw_SampleTable") val dfProject =…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-20T17:12:02.45+00:00
Dheeraj 351 Reputation points
accepted 2021-07-21T12:16:29.24+00:00
Dheeraj 351 Reputation points
1 answer

IsDelta = True, Merge gets error "Not a delta table"

I'm running a Spark 2.4 cluster for which we've created a delta table and the function IsDelta returns true for the table (well, path), however, when trying to run an merge statement, we are getting the error "<table> is not a Delta…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-19T23:24:14.517+00:00
Ryan Abbey 1,186 Reputation points
commented 2021-07-20T22:47:19.917+00:00
MartinJaffer-MSFT 26,156 Reputation points
0 answers

The function 'json' expects its parameter to be a string or an XML. The provided value is of type 'Null'.

PipeLine Design: FTP------>>ADLS------>>Staging Area(Blob Storage)------Synapse( Azure WH) Note : Error Occurs in Staging Area,How to Clear This Error and Please Suggest One...

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-07T13:00:27.887+00:00
VamseeKrishna Venigandla 1 Reputation point
commented 2021-07-20T01:13:00.053+00:00
ShaikMaheer-MSFT 38,551 Reputation points Microsoft Employee Moderator
1 answer

What are these tables starting with 'SqlAnalyticsConnector' doing in my azure data studio?

I have a Azure SQL Data Warehouse which I open in SSMS as well as Azure Data Studio. But when I open it in Azure Data Studio, there are these tables that start with 'SqlAnalyticsConnector.xyz' they do not appear in SSMS. How do I make them hide…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-08T08:58:44.4+00:00
Dheeraj 351 Reputation points
commented 2021-07-19T23:53:07.2+00:00
Saurabh Sharma 23,851 Reputation points Microsoft Employee Moderator
1 answer One of the answers was accepted by the question author.

Connect On-Premisses SSAS on Azure Synapse Serverless

I'm trying to connect SSAS on a external table in Synapse Serverless. I'm can browser throught databases and tables and the connection is sucessfuly, but when I try to finish, the following error apears: NO_BROWSETABLE is not supported for SET. …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
SQL Server Analysis Services
SQL Server Analysis Services
A Microsoft online analytical data engine used in decision support and business analytics, providing the analytical data for business reports and client applications such as Power BI, Excel, Reporting Services reports, and other data visualization tools.
1,344 questions
asked 2021-07-17T22:02:01.563+00:00
Guilherme Aguiar 21 Reputation points
accepted 2021-07-19T12:20:11.357+00:00
Guilherme Aguiar 21 Reputation points
2 answers One of the answers was accepted by the question author.

Read-only replica for SQL DWH and AAS suitability

Hi folks! We're using Dedicated SQL pool (formerly SQL DW) for reporting system, mainly for Power BI reports with direct querying for datasource views. Our current tier is the minimum serverless level - Gen2: DW100c and during the active time of…

Azure SQL Database
Azure Analysis Services
Azure Analysis Services
An Azure service that provides an enterprise-grade analytics engine.
481 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-12T08:33:11.4+00:00
Vadim K 21 Reputation points
commented 2021-07-18T07:52:03.227+00:00
Vadim K 21 Reputation points
1 answer One of the answers was accepted by the question author.

What do the Livy related errors mean in Azure synapse notebook

Someone please tell me what these errors mean and how to deal with them to have a successful pipeline. Failed to create Livy session for executing notebook: LivyHttpRequestFailure:

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-06-23T17:18:36.767+00:00
Dheeraj 351 Reputation points
accepted 2021-07-18T06:54:31.677+00:00
Dheeraj 351 Reputation points
0 answers

synapse CI/CD error deploying after upgrading to latest version. 1.6.0

using Synapse workspace extension v1.6.0 last working version 1.5.0 No changens in setup after upgrade. When deploying a release I get "Error during execution: Error: Failed to parse package: SyntaxError: Unexpected token s in JSON at…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-15T12:43:06.1+00:00
Kristian Birkeland 6 Reputation points
commented 2021-07-16T17:22:28.827+00:00
KranthiPakala-MSFT 46,647 Reputation points Microsoft Employee Moderator
1 answer One of the answers was accepted by the question author.

Capacity limits for dedicated SQL pool in Azure Synapse Analytics

As per the information in Microsoft Learn on "Capacity limits for dedicated SQL pool in Azure Synapse Analytics", Database Objects section; Dependent on column data type. Limit is 8000 for char data types, 4000 for nvarchar, or 2 GB for MAX…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-10T07:20:22.66+00:00
Shweta Barhate 21 Reputation points
accepted 2021-07-16T14:54:05.91+00:00
Shweta Barhate 21 Reputation points
1 answer

SAP ECC or SAP S4 -Serverless Pool/SQL dedicated poool

Hi Guys, Can we have direct connection to SAP ECC or SAP S4 to Server less pool or SQL dedicated pool in synapse? if so can you provide some article around it... We know CData can do it https://www.cdata.com/kb/tech/saphana-odbc-polybase.rst

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-09T16:00:29.153+00:00
Dondapati, Navin 291 Reputation points
commented 2021-07-16T11:52:15.227+00:00
PRADEEPCHEEKATLA 90,661 Reputation points Moderator
1 answer

Date functions in spark sql

Hi, I am using sql query in synapse notebook and unable to use getdate() function in sql query. Please advice. this query not working df= spark.sql("""SELECT period_id FROM dim_period_dates WHERE GetDate() -1 BETWEEN period_start…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-09T11:39:19.34+00:00
Rathnakar Dara 1 Reputation point
commented 2021-07-16T11:51:10.12+00:00
PRADEEPCHEEKATLA 90,661 Reputation points Moderator
1 answer

Migrate IBM Netezza to azure synapse analytics

We need to migrate the IBM Netezza data into azure synapse analytics and as of now we have approximate 55TB data is available which need to migrate so should I use the azure synapse pathway tool as per prerequisite. …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,385 questions
asked 2021-07-09T09:58:36.62+00:00
Prashant Chauda 1 Reputation point
commented 2021-07-16T11:50:02.437+00:00
PRADEEPCHEEKATLA 90,661 Reputation points Moderator