Azure Data Factory - Data Flow - parameters in group by

Gabryel, Andrzej 166 Reputation points
2020-12-17T10:31:02.933+00:00

Hi, I want to use parameter in Azure Data Factory Mapping Data Flows to determine which columns will by used to group by in Aggregation tool. I used Array as parameter type.

49173-image.png

I used this parameter in group by in aggregate tool.

49182-image.png

However in the results tab I can see one column as an array instead of multiple columns.

49104-image.png

My Goal is to have a parameter with list of columns. Each columns will be used as a separate column in group by in Aggregate tool?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,459 questions
{count} votes

Accepted answer
  1. Nasreen Akter 10,736 Reputation points
    2020-12-30T16:36:12.22+00:00

    Hi @Gabryel, Andrzej ,

    if you add column pattern in the aggregates tab with the following expression you will get all the groupBy columns you have passed in the test array parameter(please see the screenshots below):

    in($test, name): this expression will give you all the GroupBy columns you have passed in the parameter
    !in($test, name): this expression will give you all the other columns in the table except the GroupBy columns you have provided in the parameter

    52303-aggregate-1.jpg
    52245-aggregate-2.jpg

    Please let me know if this helps. If the above response helps, please "accept the answer" and "up-vote" the same! Thank you!

    4 people found this answer helpful.

0 additional answers

Sort by: Most helpful