Distinct in blob storage

Vineet S 1,390 Reputation points
2024-08-09T08:51:08.86+00:00

Hi how will get distinct product code from blob storage contains rows p1, p2, p1 .. Please share screenshot

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,623 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Nandan Hegde 36,146 Reputation points MVP Volunteer Moderator
    2024-08-09T09:44:37.8266667+00:00

    1st step is to use lookup activity as seen below:

    https://learn.microsoft.com/en-us/answers/questions/1856348/lookup-in-blob-storage

    And then you can use the array and take union of that array to avoid duplicates and get unique values:

    https://datasharkx.wordpress.com/2022/07/24/listing-unique-records-within-an-array-in-azure-data-factory/


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.