Parsing Error
Hello experts, I am reading txt files (which has sql queries) and concatenating it to a array variable. Then I convert it back to a string variable using the following expression @replace(replace(join(variables('sql_query'),' '),…
Calling Databricks activity with MSI resulting in Error Code 3207
We are following this link1922818 for setting up Databricks activity in our Datafactory. When pipeline is executed, we are getting below error Any help to resolve this is much appreciated. We confirm following things... Datafactory…
![](https://techprofile.blob.core.windows.net/images/VfQFAmOikEWfBHko2XlWTA.png?8D7F33)
How to load the different api data dynamically into corresponding tables
Hi @Anonymous , Do you have any idea on how to load the api data dynamically into corresponding tables? As mentioned in the earlier question i have created tables for the url's ,schema mapping and corresponding destination tables. As part of…
Rest API as a data source and output in azure sql database
Hello, i am using web activity as a source to call rest api in adf, also my transformation is debugging properly but in my out as a SQL database it is reading only the object data not the array in it. Please tell me how i can achieve. Regards
ADF, Pipeline, Copy Activity
All, I have to copy lot of tables from On-Prem to AzureSQL. I setup a pipeline and copy activities to accomplish the copy. How do I disable IDENTITY insert off to ensure that the identity column values are brought over from the source as they are…
How can I return the last cell in a column from excel file in set variable activity adf?
I have an excel sheet and need to extract the data in the last cell of a column to put into a new column in my sink file. I am using a set variable activity, is there a way to specify and return the last cell in the column? I can only make it work if I…
Gathering Analytics from txt files from Blob container with complex file paths
I want to be able to perform analytics on several txt files that are stored in a blob container within a storage account. The file path looks something like shoppingcenter\location\2020-05\shop\myfile.txt there's several location folders, several…
ADF in Azure Synapse Analytics Workspace: Trigger Now gives error message "Sync and publish your changes before clicking "Trigger now"."
We have a simple ADF developed in Azure Synapse Analytics Workspace. Running it via "Debug" works fine. Running it via "Trigger Now" gives the error message Sync and publish your changes before clicking "Trigger now". …
How to write If --else if--- statement in Azure Mapping Data Flow Expression
Hello I am new to Azure Mapping data flows? I wanted write expression in mapping dataflows equivalent to If ( Account = 'A100') Then 'Normal' Else If (Account='B200') Then 'Gross' How I can write above logic in mapping data…
exporting data factory pipeline
hi, i have multiple adf pipelines in data factory, i want to move the entire pipeline structure to another data factory in different resource group. can you help me how i can i do that?
how to copy data from bloob storage to a output file by using copy pipeline activity
Hi Team, I have a requirement in azure data factory, That is in azure blob storage we have 2 files separately named employee_info and Department_info I have to create a output file with the below transformations 1.need Create Pipeline to copy the…
![](https://techprofile.blob.core.windows.net/images/Mf9c7ohnrkCeGRUyd8Ko9A.png?8D8B19)
MSDN Forum: Data flows to Onprem sql connectivity not enabled in Azure data factory
I was trying to copy the data flow Blob to Onprem SQL server using data flows. When trying to choose a SQL Server (On Prem) as sink, sql server icon is diabled in the sink linked service. Any reson for the same? Anyhow able to connect with normal…
![](https://techprofile.blob.core.windows.net/images/VfQFAmOikEWfBHko2XlWTA.png?8D7F33)
Azure SSIS IR custom DLL installation with main.cmd
I have used a azure SSIS IR to execute my SSIS package from on premise to azure adf but its failing as we epplus dll are used in script task of SSIS packages and same I tried to add using main.cmd but still facing issue in this .
HOW TO REPLACE \ SLASH IN AZURE DATA FACTORY WITH FUNCTIONS
HOW TO REPLACE \ SLASH IN AZURE DATA FACTORY WITH FUNCTIONS
Copy Activity - Enable Logging - Need to provide log file name
I am using the Enable logging option to log the details of the copy activity into a blob. Below are the options that I have set. The details of the copy activity are logged correctly in the blob. However, the log file name is…
![](https://techprofile.blob.core.windows.net/images/nU6nYqttiUqkasJ2PMYbbQ.png?8DB643)
Data Factory Stored Procedure Error Cannot find the object
I have a stored procedure to truncate tables and it works absolutely fine in SQL Server EXEC [staging].[USP_TruncateTables] @tableName = 'example', @SchematableName = 'staging.example'; So I can use this truncate Script for all the staging tables However…
The Read method cannot be called
Hello, I am having an issue with the npgsql connector to postgres. Error message below: 'Type=Npgsql.NpgsqlException,Message=Exception while reading from stream,Source=Npgsql,''Type=System.NotSupportedException,Message=The Read method cannot be…
Synapse query failed after 6 minutes from Data factory
Hi, I'm using the copy activity to extract data from Synapse analytics (SQL DWH). After exactly 6:38 minutes the query fails and the error is a Timeout Error. If a run the query from ssms, works. I set up the max time for query timeout: …
Cannot connect to SQLMI database when using Azure Auto Resolve Integration Runtime
Hi All, I am loading data from ADLS Gen2 into SQLMI. When i am tried to create a linked service using Azure Auto resolve IR to connect to SQLMI using SQL authentication , i am getting the below azure message. Enabling Azure services in NOT an option…
Data Factory v1 - edit linked service with dependancies.
We've moved all of our data factory v1 jobs to v2 except for a few that we're unable to at this point. I need to edit the values in a linked service. I understand that that is no longer supported in the portal and must be done via powershell or rest…