Identity function on column
Hi. I have an Identity column set for one of my columns in the Azure SQL database. However the column values are not shown as expected. I want to have a sequential numbering to be set for this column, however the values are getting set randomly. …
Updating Python Packages in a Synapse Workspace (Preview) Spark Pool
I've followed the steps outlined here exactly: https://techcommunity.microsoft.com/t5/azure-synapse-analytics/add-manage-libraries-in-spark-pool-after-the-deployment/bc-p/1809603#M143 Namely, generate a requirements.txt file using py -m pip freeze…
Using SSMS Import Flat File Wizard with Azure Synapse
I just want to load a simple CSV file into Azure Synapse. Is it possible to use the "Import Flat File Wizard" in SSMS to do that? If not, what is a quick way to import my small CSV?
SSAS - Data Mining for Business Users
Good day, I have strong push for business users to do data science & dta mining, where they setup their rules and anomolies gets highlited etc I am looking for a tool that i need to demo very soon - Any Ideas, please help Data Mining for…
BI SQL Data Science & Data Mining tool to do forensic / other analytics
Good day, I have a need to improve the analytics within the company, from olap reporting & powerbi theres a strong need for users to analytically interpret any set of data Looking into data science tool to plug into data warehouse Similar…
Temporal table in Azure Synapse
Hi everyone, is it possible to create versioning tables, or Temporal tables in Azure Synapse? I've been researching the internet for a while and can't seem to find anything at all
ADF Copy activity with PolyBase column size limit (8000 bytes)
There seems to be an error when loading columns with sizes greater than 8000 bytes via ADF Copy with Polybase and Synapse. Error message: { "errorCode": "2200", "message":…
Exporting Metadate from a View in Synapse to import into ER Studio
Is is possible for me to export the metadata from Synapse view and then import into ER Studio?
Azure Datawarehouse Performance Tuning
Hi..Am currently working on Azure Sql DB to Azure Datawarehouse migration.. After migration when I tired to run fact load sp am facing severe performance issue.. That sp which has while loop in it and it has to iterate for 7000+ plus times. For each and…
Getting SSL certificate error while connecting to Synapse SQL pool from Databricks in Azure using JDBC
--------------------------------------------------------------------------- Py4JJavaError Traceback (most recent call last) <command-3031308706598466> in <module> 6 .option("tempDir",…
There are no adventureworks tables in datawarehouse
Trying to create an azure datawarehouse using powershell and want to import sample adventureworks data in it using powershell. Passing samplename parameter as "AdventureworksLT". But when the Dataware house is created,there are no…
ADW : Any changes to HEAP in Gen3
Hi All, We are using HEAP for transient data and want to check with experts if there are any upcoming changes to HEAP in Gen3.
Azure Synapse Analytics - Resource Class assignment to Active Directory Group
I've assigned resource_class to a specific Active Directory group, but the user within that group gets the default resource_class assigned when executing queries. User X is assigned to AD group Y. Y is assigned to 'mediumrc' but the execution…
Synapse not supporting pagination JPA
When trying pagination with spring data jpa; getting duplicate records from other page and some records are being skipped.
How to read a CSV file with Line break and Quotes through PolyBase in Synapse
Hi All, I have an automated source that generates Excel file with data that can contain line breaks or double quotes or some delimiter values. I am converting this Excel file to CSV using ADF Copy activity and to handle column delimiter in data i have…
SYNAPSE STUDIO- SQL POOL -(NEW)OPTIONS DISABLED
Hello Community, I have been facing error related to creation of new sql pool via synapse stuido. The (New) options is disabled over synapse studio. Please could anyone let me know why is the reason behind it. THanks, Deepak
ADF Copy activity using PolyBase fails to load "Date" type to Synapse
When loading Date type from a parquet file to Synapse with "Date" type via ADF Copy with PolyBase, the ADF throws the following error: { "errorCode": "2200", "message":…
Spark pool does not reflect the contents of requirements.txt
I have checked the Microsoft Learn description below and am trying to add the Python libraries to the Spark pool. https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/apache-spark-azure-portal-add-libraries I created…
Performance, Pros and Cons of using Logic Apps or Azure Data Factory for Orchestration of huge ADW and Performance, Pros and Cons of using ADFV2 Mapping Data Flows
Please share Performance, Pros and Cons of using Logic Apps or Azure Data Factory for Orchestration for huge ADW and Performance, Pros and Cons of using ADFV2 Mapping Data Flows
Data Disposal/Retirement in Azure Synapse
Can someone please let me know how to achieve data disposal/retirement in Azure Synapse Analytics (SQL DW) and how to ensure it is happening safely in Azure.