Temp table in adf
How to use temp table in adf for sql server without creating store procedure
![](https://techprofile.blob.core.windows.net/images/UVyLn-Xlr0apNce5TRX1RA.png?8DBA3B)
Error in SOQL Query with Salesforce V2 dataset
Hi, I'm attempting to use the SOQL Query option to filter columns in the Salesforce dataset, but I'm running into the following error. Any help would be appreciated. Thanks!
Data Factory to pull information from Snowflake using external stage to Blob Storage
We are creating an ADF pipeline to pull information from Snowflake to Blob Storage. Reading the help article https://learn.microsoft.com/en-us/azure/data-factory/connector-snowflake?tabs=data-factory I am getting some pre-requisites to use this process…
Business Central Connection with Azure Data Factory
Hello, is there a way to connect Business Central to Azure Data Lake? I am only seeing one for NAV/AX and D365 CRM Apps.
Convert query in adf
Hi, how to convert the query of temp table and variable in adf sql query.. Am unable to convert.. Tried cte --/* DECLARE @Period VARCHAR(20)='202406', @Facility NVARCHAR(20)='', @ShowFacility BIT=0, @GroupBy…
ADF and external source data handle
I require that the business has more than 60 packages(sources are ERP and other applications), which must be refactored into ADF pipelines and moved to Azure Storage services. The issue is all these packages have complex multi-step logic with…
Error using Azure Data Factory to Copy data (Using Upsert) from Azure Blob to Azure SQL database
Hi all, I keep getting this error when I perform an upsert (under copy activity) with this error code: Failure happened on 'Sink' side. 'Type=System.NullReferenceException,Message=Object reference not set to an instance of an…
How to Work with UTC Timestamps in Azure Data Factory
I need assistance in writing a Data Flow expression in Azure Data Factory to generate the current UTC timestamp in the format yyyy-MM-ddTHH:mm:ss.SSS. Additionally, I would like to understand how to create expressions that allow me to both subtract and…
Storing JSON in Azure SQL Table
How can I store JSON responses received from a web activity within Azure Data Factory in an Azure SQL table? The JSON output contains special characters that need to be preserved in the table. I have tried passing the JSON as a string to the stored…
ReferenceError: Cannot access 'ne' before initialization when creating Airflow environment setup in Azure Data Factory.
I am trying to create the Airflow environment with Data Factory through the web. I specified just the required default parameters, but I am facing ReferenceError: Cannot access 'ne' before initialization. I don't know what it's trying to call under the…
SFTP Requirement
Hello Team, I want to access the files from the SFTP drive and read the the file and upload into azure sql database via azure data factory pipeline. I tired to find the good document. But not able to find. Please any one can share the suitable link to…
Configure self-hosted integration runtime over private network
Hi, As per my understanding self-hosted integration runtime uses https over public internet to transfer data between on-premise and Azure cloud services(Blob/Database). Please correct me if I am wrong, and also advise if its possible to configure…
ADF storage event trigger pipeline is not triggered when file is SFTP to Azure Blob Storage.
Hi, I have a file coming from on-prem app through SFTP to Azure Blob Storage container. I set up an event storage trigger on my pipeline. However the pipeline is not getting started when the file (blob) created on Azure storage container through SFTP. On…
![](https://techprofile.blob.core.windows.net/images/0Ll-SHZePUetqUTMg1J81A.png?8D7EDA)
Business Central Connector for Azure Data Factory
Is there a connector that can be configured to allow data to be extracted from Business Central into Azure Data Factory? Please do not confuse my query for AX or Finance and Operations.
Linked Services for Salesforce in Azure Data Factory
I am having issue creating linked Service in Azure Data Factory to Salesforce. I get following error Unable to establish connection to the Salesforce environment using provided client id and client secret, please verify the details. Error message:…
we deliver a reporting solution from D365 Finance and Operations using “Export to Datalake” functionality, ADF, and a on-prem SQL Server to, customer have asked us to come up with a solution to swap the “Export to Datalake” functionality.
we deliver a reporting solution from D365 Finance and Operations using “Export to Datalake” functionality, ADF, and a on-prem SQL Server to, customer have asked us to come up with a time estimate to swap the “Export to Datalake” functionality. what is…
Why isn't source considered while determining location of IR for copy activity in ADF?
This is an excerpt from the Azure IR documentation: For copy activity, a best effort is made to automatically detect your sink data store's location, then use the IR in either the same region, if available, or the closest one in the same geography,…
Azure Data Factory Salesforce Connector and Salesforce Bulk API v2.0 support
As per documentation: The Salesforce connector is built on top of the Salesforce REST/Bulk API. When copying data from Salesforce, the connector automatically chooses between REST and Bulk APIs based on the data size – when the result set is large,…
![](https://techprofile.blob.core.windows.net/images/st_d3wktmEyXXwequj2STg.png?8DC69D)
How to write a dynamic expression in Flatten transformation for "Unroll by" and "column mapping"
I am developing a generic data flow to read several JSON files, flatten them and load into the parquet files. Following are the two sample JSON files. I want to select all the attributes under the array Value. Appreciate your inputs. {…
Distinct from blob storage
Hi, how to read distinct data from blob storage without using data flow ie table1---- company code(columnname) p1, p2, p1,p5, p2.. Pls share screenshot