Blob datatype conversion

M, Murugeswari (Cognizant) 456 Reputation points
2022-04-18T12:29:09.61+00:00

We have migrated few of our tables from on premise oracle to Dedicated SQL Pool via ADF. In that we have a table with blob datatype column. The records in that on-premise (oracle) table are in the format as shown below:-

193872-image.png

But when we migrated to dedicated pool, we could seethe column datatype has changed to nvarchar and records are in the format as shown below:-

193873-image.png

So is there any way to validate the data

Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,696 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 38,401 Reputation points Microsoft Employee
    2022-04-19T15:48:48.85+00:00

    Hi @Anonymous ,

    Thanks for posting query in Microsoft Q&A Platform.

    Azure Synapse SQL not supports BLOB data type. Hence you are seeing BLOB converted as you mentioned above. Click here to know more about data types supported in Azure Synapse SQL.

    Also, When we use Copy activity and Oracle as source then BLOB data type will be converted as interim data type and there by loads to Sink. Click here to see interim datatypes related to oracle data types.

    If you would like to validate data, then we can consider validating other columns and see all of them loaded or not. OR we can consider validating that column data alone between stage(blob storage) and sink.

    Between, below video helps with validating data logic in ADF.
    https://www.youtube.com/watch?v=i2PkwNqxj1E

    We can also use Assert Transformation to data quality and validation checks.
    https://www.youtube.com/watch?v=_NzWpTRxt0s

    Hope this helps. Please let us know if any further queries.

    --------------------

    Please consider hitting Accept Answer button. Accepted answers help community as well.


0 additional answers

Sort by: Most helpful