synapse analytics environment
hello, How is it possible to create a synapse environment by running a script as opposed to using the azure portal? Thank you
Azure Synapse Bitbucket integration
Is there a way, i can use Bitbucker for source control. If Bitbucket integration feature is on the roadmap, is there an alternate solution for this? Synapse to GitHub and from GitHub to Bitbucket
Can we trigger a synapse pipeline based on Event Grid system topic output
Hi Team, Currently we have an event grid system topic which triggers an azure function to create views on synapse serverless pool. Once the above process is done, we move the data from serverless to dedicated sql pool. we would like to…
Datafactory Event Trigger Unable to list Blobs
Hello everybody, I am trying to set up an event trigger for a blob creation event in my synapse workspace but somehow I can't seem to make it work. I can find the storage account and the container. But when I want to filter for files it simply states…
How do I remove the row in Excel file? - Azure Synapse Analytics
Hi, I wanna remove the row in Excel file in Azure Synapse Analytics. As shown in the attached image, the source Excel file has an unnecessary second row. I tried to remove it in ADF, but I don't know what condition to set in the component…
Is the Azure notebookutils python package available to on a local development system?
We are developing a python application to run in Azure Synapse. We want to use mssparkutils, which is part of the notebooktuils package. It doesn't appear that notebookutils is available in the pypi index to be downloaded locally. Is it available…
Load mutiple files listed in a dataframe to a dataframe
I have a list of files from my ADLS storage in a dataframe as per the image below. What I would like to do is to load the files listed in accountdf into one dataframe. Can someone provide some pointers.
Want to migrate from one Synapse workspace to another Synapse workspace
Hi team, Want to migrate from one Synapse workspace to another Synapse workspace. One being Dev environment, another one test environment. Please provide leads. Regards, NagaSri
Is there a way to create a pipeline that stops all triggers at once?
Is there a way to create a pipeline that stops all triggers at once? I need to stop all triggers at the time of release to release, so if there is a good way to do this, please let me know.
How to create External table with different collation
Please confirm can we create a External table with Different collation on Azure Synapse Database. Can we have different collation on object level ? Azure Synapse Database collation : Default (SQL_Latin1_General_CP1_CI_AS) Expected Table creation…
Temporal Tables
Hi everyone, Does Synapse Analytics support Temporal Tables ? What are the components/services that do support temporal tables? Thank you
Copy data activity in Synapse - ADLS2 to dedicated SQL Pool - Wildcard problem
Hi everyone, I am using the copy data activity in a Synapse pipeline to load data from azure data lake v2 to a SQL dedicated pool. I'm facing a problem to read several parquet files from a directory in the data lake. The folder has a simple…
Creating external table using delta format in Azure Synapse ADLS Gen 2
Hello, I want to create a external table using the delta format in Azure Synapse. I'm using a ADLS Gen 2 Data Lake. Here is the relevante part of the script I'm using to create the table: WITH ( LOCATION = 'test/staging/CaseComment/**', …
How to install nuget packages from ADLS to synapse notebooks ?
Hi, Previously in our project we have used #r command to install the nuget packages. But due to private endpoint restrictions we are unable to install directly. Can anyone help me how can I use the nuget packages from ADLS primary storage to…
Azure Dedicated SQL Pool (Formerly SQL DW) : Not able to connect the server with my AD account
Hi, Could you please guide me on connection issue ? I used to connect the Azure Dedicated SQL Pool (Formerly SQL DW) through SQL Server Management Studio with my Azure AD credential. It was working till yesterday (26th July 2022). But, Today I am…
Synapse R Integration
I believe R integration is not available in Synapse for now, is there any alternate work around to integrate R with Synapse?
Azure Synapse Lake Database on SQL Serverles Pool Error: Operation DROP FUNCTION is not allowed for a replicated database.
Hello Community, When I attempt to execute the following code on our Azure Synapse Lake Database I get the error: Operation DROP FUNCTION is not allowed for a replicated database. The code that generates the error is as follows: DECLARE…
What is the impact of Databricks IP allow/denylists on orchestration using ADF/Synapse
Databricks jobs are often scheduled using Azure Data Factory and/or Synapse. What is the impact of Databricks IP access lists on this orchestration? Can we add service tags to the whitelist to allow ADF? Thanks for elaborating.
Synapse Studio - 403 Unauthorised - Even with Owner permissions
I am having trouble access Synapse Studio for a workspace that I have "Owner" permissions to.
Onprem SQL Server password saved to KeyVault doesn't work on LinkedService
Failed to get the secret from key vault, secretName: XYZ, secretVersion: 123, vaultBaseUrl: https://abc.vault.azure.net/. The error message is: An error occurred while sending the request. Unable to connect to the remote server A connection…