Creating a hashdiff using SHA1 on azure synapse pipeline

asked 2023-01-13T14:17:12.83+00:00
Astrid Malanka 46 Reputation points

Hello,

We use the datavault methodology and I need to create a hashdiff, the issue is that it is too many columns and it is giving me an error on the sql code when I try to use the copy on the pipeline.

Is there a way another way to create the hashdiff? on ssis I use c#

thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,600 questions
No comments
{count} votes

Accepted answer
  1. answered 2023-01-16T18:29:05.8433333+00:00
    HimanshuSinha-msft 17,566 Reputation points Microsoft Employee

    Hello @Astrid Malanka ,
    Thanks for the ask and welcome to Microsoft Q&A .

    I am assuming that the ask here is how to use hashing in Analytics . The copy activity may be not the correct activity , if you use data flow , then you can use the CRC32/SHAI/SHA2

    User's image

    Please read about this more . [https://learn.microsoft.com/en-us/azure/data-factory/data-flow-expression-functions#expression-functions-list

    User's image

    Thanks
    Himanshu


0 additional answers

Sort by: Most helpful