Content
How to get data for all the fields listed there in CRM using Azure data factory
For getting full load data from the CRM database to the Azure SQL database, I am using the table option in the copy source and getting the data for all the columns. But when I am trying to get incremental data using Query option for which I am using…


Azure Data Factory json manipulation
Hi, Good day. We have an input JSON that is of the following schema: { "result": [ { "table": "test1", "field": "completed_on", "sys_id": "7d6a0a84dc0", …
It must be software level, energy saving is powerful antivirus
Tell me how to keep energy saving always enabled on Desktop without battery that also means laptops.
Custom Activity runs for hours and never completes in ADF (trying to run a sample python script)
Hello, I am trying to run python script in a custom activity as shown in this article. https://learn.microsoft.com/en-us/azure/batch/tutorial-run-python-batch-azure-data-factory Followed it word by word and trying creating pools multiple times and ran…
Iam receiving json data from restapi link, with multiple arrays how to pull data into SQL db
@ShaikMaheer-MSFT data structure like this { } Json. [ ] Links { } 0 { } 1 [ ] Results{} Entity - under again [] links


Copy data activity import CSV issue when Line Feeds are mixed in column data and conflict with end of file delimiter CR LF
You cannot set the value to \r\n as a distinct option which doesn't make sense considering it is a standard row delimiter on most text extracts, forcing it is not an option nor can you create a parameter to set it manually. The error generated when you…


How writing partitioned parquet files from a csv file
Hi, I need to know how I can write partitioned parquet files into an Azure Blob storage reading a single csv file. I'd like to partition by year, creating year folders and putting the year partitioned files in the corresponding folder. Any helps to me,…
ADF-SAP Table connector Memory Error for SAP ECC Source
Hello, I am trying to retrieve the data from SAP ECC-ERP 6.0 on Netweaver 7.5 using ADF-SAP Table connector, I can access the SAP tables using Preview Data option, however while trying to ingest the data to ADLS getting the below error: Could you please…


Azure Data Factory | Web Activity
Hi I want to get a token from graph api using the Web Activity The token request is a multipart/form data type I am unable to send data in this format Let me know the steps for this We are using graph api from documentation


Upsert options not showing in Copy Acivity after initially creating pipeline. Settings are still in JSON?
I am not getting an error, but I think this might be UI bug? After initially creating Upsert and adding keys, those options no longer show up in UI. The settings are in the JSON, but not are not displayed in UI. Anybody else see this behavior? My…


ADF Copy Data REST API Pagination not ending on condition
Hi there, I am trying to fix my endCondition on my paginated copy date REST api activity. My API only returns the current page and the total pages. So I tried to add a endCondition of... EndCondition:$['page']Const$['total'] aka. end if current page is…


Enable Interactive Authoring Under Managed Virtual Network in Azure ADF pipeline
Enable Interactive Authoring Under Managed Virtual Network in Azure ADF pipeline. I have a requirement wherein I have to enable the interactive authoring option under Managed Virtual Network in Azure ADF pipeline via AzureCLI/Azure Powershell or any…


How to copy data from Azure SQL Database to SAP system using Azure Data Factory?
I am looking for a way to copy data from Azure SQL Database table to SAP system using Azure Data Factory pipeline (Push model). Is this possible? When checked in linked services I cannot find SAP connectors in SINK DATASET. Unfortunately I am unable to…


What is the best way to copy all files from a sharepoint site to Azure blobs using data factory?
I have followed a few tutorials but it either seems to not work or it only copies one file. I don't have the paid version of Power Automate that gives me the premium items. I was under the impression that I can copy multiple files to an Azure Storage…


How to bearer access token generate in data flows as a source transformation
How to generate bearer access token generate in data flows as a source transformation


Can't import Live resources to GitHub Repo
I have an existing GitHub repository and I want to import resources from my ADF Live environment to the repo. I can connect to it fine and browse the repos in my account, but when I click Import I get this error. You don't have permission to import…


Schema drift not working on Unpivot activity/transformation on Azure Data Factory
Hi, I'm trying to use the "Unpivot" transformation on a Source that doesn't have schema pre-defined (Schema Drift is activated). The "unpivot" transformation generates the following error: at Unpivot 'UnpivotForPlaysOrViews': web |…


ADF load data to Rest API Sink
My data is present in Azure SQL Database table, and I have to PUT the data in Blackline API in text format, using ADF Blackline API example : https://developer.blackline.com/docs/data-ingestion-accounts-api/1/routes/dataingestion/accounts/put URL :…


DateTime source values showing as NULL in Azure Data Factory - Data Flows
Hi, Is there a reason why my data flow cannot read/treat the DateTime input column? In my source file, I have a column named 'Date' with DateTime values of format 'yyyy-MM-dd HH:mm:ss', but the data preview always shows NULL values. Hence, to fix this…


Rule based mapping - Azure data factory
Hi, I am trying to use rule-based mapping on my input schema, which is a CSV file. For some reason, I can't achieve what I want. This is the screenshot of my input schema, as you can see I have columns that contain %Concurrent% & %Plays%. What I'm…

