An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Can we execute a Stored procedure(Azure SQL DB) through synapse Notebook??
I have created stored Procedure which has Merge Statement to perform slowly changing dimension, I would like to execute this Stored procedure from synapse notebook. Is there any way to perform this ?
Azure Synapse Analytics
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory Linked Service settings for SQL is not consistent when deployed via CI/CD
In the development Azure Data Factory (ADF) the linked sql connection's Authentication Type is set as System Assigned Managed Identity. As shown in the image bellow. The ADF is connected to Azure Repo and when deployed via ARM template in CI/CD…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Data Modeling in Azure
Hi All, I would really appreciate if someone please help me with Data Modeling books within Azure scope that entails various techniques such as dimensional modeling , data vault. Any good links would be also a great help. Thanks in advance.
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Index Out of Range Error When Creating SnowFlake Linked Service
I have tried several times to create a SnowFlake linked service. Every time I try I receive the same error. The portal offers no other information on what is happening. Found someone else on SO having the same issue. Can anyone help with this? The…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Oracle connection string in Azure Key Vault
How does one specify an Oracle connection in key vault? the connection type is a service name Unfortunately there is no information on this page: https://learn.microsoft.com/en-us/azure/data-factory/connector-oracle?tabs=data-factory So it needs…
Azure Key Vault
An Azure service that is used to manage and protect cryptographic keys and other secrets used by cloud apps and services.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Data-Factory: Snowflake Linked Service KeyVault
Currently the implementation of KeyVault inside the linked service template for Snowflake is not properly done. Even when keyVault is referenced for the password I am getting the following message: It would be helpful if the the…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Can I use a KeyVault Connection String with the Azure Data Factory Mysql Linked Service Driver v2.0?
Hi all, I currently use a V1.0 MySQL linked services as part of my Azure Data Factory setup. I use a secret connection string stored in Azure Key Vault. I am being asked to upgrade the linked service driver to 2.0, but it seems this does not support the…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Need help on parameterization of Integration Runtime and Azure Key vault Secrets on link service in Azure Data Factory pipeline
Hi, I have to migrate 90 clients database from Azure Managed Instances databases to Azure VM Data Servers. For the above requirement, I have created the below resources * 90 Azure Data Factory Pipelines * 90 self-hosted integration runtime as each…
Azure Key Vault
An Azure service that is used to manage and protect cryptographic keys and other secrets used by cloud apps and services.
Azure Database Migration Service
An Azure service designed to help simplify, guide, and automate database migrations to Azure.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
SQL Server Integration Services
A Microsoft platform for building enterprise-level data integration and data transformations solutions.
Error in Web Activity - Data Factory
Need your assistance, Guys. I am building a pipeline in Azure Data Factory which will do the following steps: Query the Azure Sql DB to get list of unique email addresses (lookup1 activity) For each email address the Store Procedure will…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Not able to parameterized the linked service for Azure Batch in ADF
I want to create a parameterized linked service in Azure data factory for Azure Batch Account. But it's not giving option for adding dynamic content. So I referred the below link for supported linked services.…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory: How to stop/start triggers in ADF environments using CI/CD release pipeline?
We would like to stop all triggers in our dev ADF environment after deploying to production. I've seen the below script being used: task: AzurePowerShell@4 displayName: 'Data Factory: Stop all triggers' inputs: azureSubscription: '${{…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ADF SFTP Linked Service Error code 9978: Access to sftp(configured on one of Azure VM) is not allowed on Azure integrate runtime.
we are having issue while creating(test connection) SFTP linked service from ADF. SFTP configured in one of Azure VM. Error code 9978 Error: Access 'XXXXXXXX.corp.XXXXX.net' is not allowed on Azure integrate runtime. please suggest .
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Issues Upgrading linked service for PostgreSQL - Data Factory
I´m using the legacy LS for Postres SQL (SHIR) and the connection is working fine, with no issues until today. I need to update the linked service (MS recomend to do it until 31/10/2024) but I´m receiving an error while testing the connection for the new…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Linked Services for Salesforce in Azure Data Factory
I am having issue creating linked Service in Azure Data Factory to Salesforce. I get following error Unable to establish connection to the Salesforce environment using provided client id and client secret, please verify the details. Error message:…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Securing args of the Python script in Azure Data Factory Custom Azure Batch Activity
Hi, Imagine running a simple ADF Pipeline that consists of 2 steps: Fetching a sensitive value - like Storage Account URL - from Azure Key Vault Executing a Python script with argsparse where this value is set as an argument with the command …
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
How to connect and query with MySQL server using Azure Machine Learning
Hi, I am currently working on a project where I need to connect to an Azure Database for MySQL using Azure Machine Learning (AML) and Python scripts. However, I want to use AML resources such as Datastore and Dataset for the connection rather than…
Azure Machine Learning
An Azure machine learning service for building and deploying models.
Azure Storage
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
Azure Database for MySQL
An Azure managed MySQL database service for app development and deployment.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Database for PostgreSQL
An Azure managed PostgreSQL database service for app development and deployment.
I wan use Show billing report by pipeline in ADF, and enabled this via CI/CD
I want enabled the feature "Show billing report by pipeline " in azure Data Factory, but I don't know how can I enabled this via Terraform deployment or ARM template deployment. How Can I do that ?
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
How to create service principal, link to the azure sql database in the azure portal.
I want to know how to create service principal to connect to azure SQL server database. (I tried by creating user assigned identity. But this also not succeeded.) The user assigned manage identity is configured by, *create user assigned manage identity…
Azure SQL Database
An Azure relational database service.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Copy files from Sharepoint into Azure Data Lake Store Gen 2 using ADF linked services ?
I have to copy files from Sharepoint into Azure Data Lake Store Gen 2 using ADF linked services
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Microsoft 365 and Office | SharePoint | For business | Windows
A group of Microsoft Products and technologies used for sharing and managing content, knowledge, and applications.
Excel or CSV file to XML - ADF
Hi, I want to convert excel/csv file into XML format. This xml is used as a body text for a rest api. Basically i need to send excel data to a REST API using ADF. Rest API accepts xml format. excel file is present in storage container. What are the…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Microsoft 365 and Office | SharePoint | For business | Windows
A group of Microsoft Products and technologies used for sharing and managing content, knowledge, and applications.