ADF Data Flow ColumnNames function issues

dirtyData 1 Reputation point
2022-05-23T16:36:53.66+00:00

Hello,

I'm trying to generate a hash based on the drifted columns only in the data flow. I understand that the columnNames() function returns an array of columns names, but when I try and plug that into the md5() function it doesn't work. How can I use the columnNames function with functions like md5 or sha to generate a hash only on those fields? 

md5(columnNames('',true()))

204811-image.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,533 questions

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Suba Balaji 11,186 Reputation points
    2022-05-24T06:25:18.973+00:00

    Hi @dirtyData

    Thanks for using Microsoft Q & A platform to post your query.

    Right now we cannot pass an array to MD5 function.

    Similar question has been discussed in the link
    Please check let us know if it answers your questions or kindly revert for further questions on it.

    0 comments
  2. MarkKromer-MSFT 5,186 Reputation points Microsoft Employee
    2022-05-25T06:37:17.873+00:00

    Are you looking to hash the column names or column values? This will give you a full row fingerprint by hashing all columns: sha2(256,columns())

    0 comments