How to export Databricks dataframe(Pandas or Scala) to Synapse analyitcs SQL table using Active Directory Password
Hi Team, I am new to the Azure, I need your expertise in Moving Dataframe from Databricks to Synapse Analytics table. We have implemented a classification model in Databricks and predicted the values and created the dataframe with Actual and predicted…
Azure Synapse Analytics
Azure Databricks

ADLS TO HIVE TABLES CREATION
Folder contains both csv and parquet files in ADLS....how to create the hive tables in azure synapse analytics
Azure Synapse Analytics
Is it possible to create Data Models in Synapse using Views which are in a database(Dedicated or Serverless) ?
By Data Model , I mean linking n number of tables/views based on their common columns. And also , if the data model is created , implement Row Level Security and Column Level Security on it.
Azure Synapse Analytics
Synapse security
Hello, I would like to write a few paragraphs on the synapse security for the benefit of the Architecture/Engineering team. For example, which parts of the security that synapse offers are benefited by which team. Can you please let me know which…
Azure Synapse Analytics
Move Azure DWH from the serverless tier to the provisioned tier
Hi folks! The official doc is quite poor regarding the topic info. Here is an instruction: Onboarding into serverless compute tier …
Azure Synapse Analytics
Help escaping with External File Format
I'm trying to create an external file format to create an external table off of a csv file with a simplified example row shown below consisting of three string fields (the last being html): foo,bar,"<div…
Azure Synapse Analytics
Communications link failure error in Synapse dataflow: com.mysql.cj.jdbc.exceptions.CommunicationsException
I'm getting a connection error in a Synapse dataflow while trying to debug or test source connection to an integration dataset linked to an Azure MySQL database. The MySQL server is working elsewhere and copy operations on the integration…
Azure Synapse Analytics
Azure Database for MySQL
SSL Certificate error Synapse Analytics
Hi, when trying to read an excel file from ADLS Gen2 with synapse notebook and pandas i recieve the following error: URLError : <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:852)> Traceback (most recent call…
Azure Synapse Analytics
Developer technologies | .NET | Other
Scala Synapse notebook dataframe.write.mode("append") Not working
I am trying to write spark sql table to Sql data warehouse. I am able to create a table from scratch but if I try to append the data to existing DW table, it fails. Here is code: *df.createOrReplaceTempView("vw_SampleTable") val dfProject =…
Azure Synapse Analytics
IsDelta = True, Merge gets error "Not a delta table"
I'm running a Spark 2.4 cluster for which we've created a delta table and the function IsDelta returns true for the table (well, path), however, when trying to run an merge statement, we are getting the error "<table> is not a Delta…
Azure Synapse Analytics
The function 'json' expects its parameter to be a string or an XML. The provided value is of type 'Null'.
PipeLine Design: FTP------>>ADLS------>>Staging Area(Blob Storage)------Synapse( Azure WH) Note : Error Occurs in Staging Area,How to Clear This Error and Please Suggest One...
Azure Synapse Analytics

What are these tables starting with 'SqlAnalyticsConnector' doing in my azure data studio?
I have a Azure SQL Data Warehouse which I open in SSMS as well as Azure Data Studio. But when I open it in Azure Data Studio, there are these tables that start with 'SqlAnalyticsConnector.xyz' they do not appear in SSMS. How do I make them hide…
Azure Synapse Analytics

Connect On-Premisses SSAS on Azure Synapse Serverless
I'm trying to connect SSAS on a external table in Synapse Serverless. I'm can browser throught databases and tables and the connection is sucessfuly, but when I try to finish, the following error apears: NO_BROWSETABLE is not supported for SET. …
Azure Synapse Analytics
SQL Server Analysis Services
Read-only replica for SQL DWH and AAS suitability
Hi folks! We're using Dedicated SQL pool (formerly SQL DW) for reporting system, mainly for Power BI reports with direct querying for datasource views. Our current tier is the minimum serverless level - Gen2: DW100c and during the active time of…
Azure SQL Database
Azure Analysis Services
Azure Synapse Analytics
What do the Livy related errors mean in Azure synapse notebook
Someone please tell me what these errors mean and how to deal with them to have a successful pipeline. Failed to create Livy session for executing notebook: LivyHttpRequestFailure:
Azure Synapse Analytics
synapse CI/CD error deploying after upgrading to latest version. 1.6.0
using Synapse workspace extension v1.6.0 last working version 1.5.0 No changens in setup after upgrade. When deploying a release I get "Error during execution: Error: Failed to parse package: SyntaxError: Unexpected token s in JSON at…
Azure Synapse Analytics
Capacity limits for dedicated SQL pool in Azure Synapse Analytics
As per the information in Microsoft Learn on "Capacity limits for dedicated SQL pool in Azure Synapse Analytics", Database Objects section; Dependent on column data type. Limit is 8000 for char data types, 4000 for nvarchar, or 2 GB for MAX…
Azure Synapse Analytics
SAP ECC or SAP S4 -Serverless Pool/SQL dedicated poool
Hi Guys, Can we have direct connection to SAP ECC or SAP S4 to Server less pool or SQL dedicated pool in synapse? if so can you provide some article around it... We know CData can do it https://www.cdata.com/kb/tech/saphana-odbc-polybase.rst
Azure Synapse Analytics

Date functions in spark sql
Hi, I am using sql query in synapse notebook and unable to use getdate() function in sql query. Please advice. this query not working df= spark.sql("""SELECT period_id FROM dim_period_dates WHERE GetDate() -1 BETWEEN period_start…
Azure Synapse Analytics

Migrate IBM Netezza to azure synapse analytics
We need to migrate the IBM Netezza data into azure synapse analytics and as of now we have approximate 55TB data is available which need to migrate so should I use the azure synapse pathway tool as per prerequisite. …
Azure Synapse Analytics
