log activity in delta parquet

arkiboys 9,621 Reputation points
2022-06-07T13:26:21.15+00:00

Hi,
Upon completion of the ADF pipeline, I would like to populate a delta parquet with one line to show that pipeline finished with some other columns, etc.
1- Should I use a copy activity for this?
2- the destination can be the delta parquet location in storage gen2
3- Not sure what the source should be? Note the source is not really pointing to anything as I only want to add a line into the delta parquet to indicate pipeline finished at this time...

Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,528 questions
{count} votes

Accepted answer
  1. Suba Balaji 11,186 Reputation points
    2022-06-07T14:23:59.06+00:00

    Hi @arkiboys ,

    You can use a copy activity with just an additional column. Source dataset can point to any dummy file with one column or dummy table.

    In the mappings tab you can remove the dummy column and have the additional column written to sink.

    Please write to us if you need more help on this.

    Thanks.


0 additional answers

Sort by: Most helpful