ADF error 'The object has not yet been initialized'
Hello, We have a pipeline that loads multiple data objects from SAP CDC source which runs okay for the past few weeks. This error only pops up in the last few days. Error: "The object has not yet been initialized." We have asked SAP team, they…
Azure Data Factory
How to fix ClientIPNotAuthorized on ADF
How do I fix the ClientIDNotAuthorized error message? I am on VPN as well.
Azure Data Factory
Copy activity convert NUMBER to DOUBLE format
Hi we use the ADF copy activity to copy data from an oracle source to azure gen2 container as parquet file. The source data contain data type NUMBER, but the copy activity converts it to DOUBLE format. Could you please provide a solution for this…
Azure Data Factory
How to Capture Row-Level Schema Failures and Redirect Bad Records in ADF During DB2 to ADLS Ingestion
We are ingesting data from an IBM DB2 source into ADLS Gen2 using Azure Data Factory (ADF) Copy activity. The Copy activity is set up with schema validation enabled. During ingestion, if a row violates schema (e.g., data type mismatch), the entire…
Azure Data Factory
Architecture design
Hi friends, thank you for your help as always. My follow up question to below: https://learn.microsoft.com/en-us/answers/questions/2282164/architecture Sorry for silly question. How to get to good hands on the diagraming tools such as Draw IO etc. , I…
Azure Data Factory
Migration of large tables
we have 800 tables in DB2 and only 25 tables have 90% of data and other 775 tables has10% of data then what will be the best approach while migrating the data first to adlsgen2 and then to hyperscale via DB2-- ADF(SHIR) - ADLSGEN2- DBR(minimal trans) -…
Azure Data Factory
ADF Pipeline error: Request content size is too large
I have a pretty basic ADF pipeline that checks a subdirectory for a group of flat files and based on the name of the file, it will load data into a SQL staging table. The ForEach activity has 7 If Condition activities which will run based on the…
Azure Data Factory
Data Factory copy activity is stuck in a "queued" status and not completing the data load
The Data Factory copy activity is stuck in a "queued" status and not completing the data load the same copy activity was running without any issues...now it is goind on queued
Azure Data Factory
Where to find updates on the Couchbase (Preview) and its release for public use?
I see that there is a preview for a Couchbase connection to copy data from Couchbase to Azure Data Factory. Is there an expected release date for a production connection to Couchbase? Specifically for the use case Copying data to a Couchbase…
Azure Data Factory
designing a partition-based ingestion strategy
We are currently designing a partition-based ingestion strategy from IBM DB2 (on-prem) to ADLS Gen2 using Azure Data Factory (ADF). Since DB2 is a database and does not have a file system, we cannot use ADF’s Get Metadata activity to estimate partition…
Azure Data Factory
JSON to CSV transformation
I would like to below given json data to given csv format using data factory if possible json: { "employee":"123", "bankdetail":[ { "banknumber" : "bank1" }, { …
Azure Data Factory
Unexpected $500 Billing for Azure Synapse
I activated the Azure Synapse service on August 1st using the default settings. However, I noticed that I am being billed $250 per day, which has accumulated to a total of $500 over the last two days. As a student, I am using this service solely for…
Azure Cost Management
Azure Synapse Analytics
Azure Data Factory

Truncated digits for numerical values in Azure Data Factory pipelines
Hello, when I am receiving numerical values within json response from API endpoint, Azure Data Factory is applying scientific notations into numerical values. But in the same time, it's also truncating last digits, see the following example: *Value…
Azure Data Factory
Connecting to On-Prem SQL Server through Change Data Capture (ADF) Issue
So I have been trying to get CDC working for the past two days but can't seem to get it to connect to my on-premise SQL Server as it seems to have issues using self hosted integration runtime inside the CDC wizard. I am trying to do incremental loads…
Azure Data Factory
Multiple Control tables or single control table
We’re currently working on a large-scale healthcare data migration project where data from on-prem DB2 is being ingested into Azure through a combination of ADF, SHIR, and Databricks. The project supports multiple ingestion modes, including one-time…
Azure Data Factory
How should DIU and Degree of Parallelism be configured in ADF when partition sizes vary significantly?
In our project, we are performing large-scale ingestion using Azure Data Factory copy activities. The source data is partitioned with highly variable sizes—some as small as 500 MB and others as large as 3 TB, all coming from the same source system. We…
Azure Data Factory
ADF Linked Service SHIR - Oracle connector 2.0 & TNSNAMES.ORA
Trying to find example on how to configure Linked service using Oracle connector 2.0 to point to TNSNames.Ora file which is available on SHIR server. Documentation is not clear. Can you please send me a link/information on how to make connection using…
Azure Data Factory
ADF managed Airflow error : 'ReferenceError: Cannot access 'Z' before initialization'
Hi, I would like to obtain the confirmation that the following error, occurring when creating a new managed Airflow integration runtime in ADF, is caused by the ADF of being new/recent (created in early 2025) and not supporting anymore Airflow as a WOM,…
Azure Data Factory
Can we compare the cost of DBR vs DLT via pricing calculator ?
Can we compare the cost of DBR vs DLT via pricing calculator ?
Azure Data Factory
Airflow Azure Data Factory VNet configuration
Hi, I'm looking to know if it's possible to inject Azure Data Factory (ADF) managed Apache Airflow in a VNet directly from the ADF studio configuration page ? If it's not possible, what is the recommended strategy to obtain this configuration…
Azure Data Factory
