Data Validation after migration from the Azure Data Factory

Question

Hi,

I would be migrating 1.5 TB data from on-premises (Oracle) to the Azure SQL database using the Azure Data Factory (SHIR).

Question-1 -Please inform how to perform the data validation between oracle and azure Sql database.

Database Size- 1.5 TB

Source Database- Oracle (on-premises)

Target Database- Azure Sql Database (Public Cloud Access-Disable)

We won't be able to enable the public cloud access to the azure sql database as per project architect and oracle database can only be connected through SHIR

Total Tables-229

Records Count - 100000+ in few large tables.

Please inform the validation method as i cannot use the Azure data flow, it does not connect to the on-premises database.

Question-2 In above I would be migrating the large amount of blob data from oracle to azure sql database?

How to validate the blob data type migration validation from oracle on premises to the azure sql database ?

Answer 1

Hello,

You will migrate data from Oracle to Azure SQL database using Azure Data Factory. As a method of data validation, it is recommended to use the copy activity in Azure Data Factory. This activity provides a validation option to check the accuracy of data between source and destination. The validation option compares the number of data and the number of rows between the source and destination. After the verification process is complete, a report is generated and gives information about the verification process result. ¹³

Blob Storage account in Azure Blob Storage Service can be used as validation method for blob data. The Blob Storage account provides a verification option to check the accuracy of the blob data. The validation option compares the number of data and the number of rows between the source and destination. After the verification process is complete, a report is generated and gives information about the verification process result. ²

I hope I could help.

Source: Talking to Bing, 23/07/2023
(1) Copy data to and from Oracle - Azure Data Factory & Azure .... https://learn.microsoft.com/en-us/azure/data-factory/connector-oracle.
(2) Copy data to and from Oracle - Azure Data Factory & Azure Synapse. https://learn.microsoft.com/en-us/azure/data-factory/connector-oracle.
(3) Connector and format for mapping dataflows in Azure Data Factory.... https://learn.microsoft.com/en-us/azure/data-factory/data-flow-troubleshoot-connector-format.