log activity in delta parquet

asked 2022-06-07T13:26:21.15+00:00
arkiboys 7,861 Reputation points

Upon completion of the ADF pipeline, I would like to populate a delta parquet with one line to show that pipeline finished with some other columns, etc.
1- Should I use a copy activity for this?
2- the destination can be the delta parquet location in storage gen2
3- Not sure what the source should be? Note the source is not really pointing to anything as I only want to add a line into the delta parquet to indicate pipeline finished at this time...

Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,259 questions
{count} votes

Accepted answer
  1. answered 2022-06-07T14:23:59.06+00:00
    Subashri Vasudevan 4,296 Reputation points

    Hi @arkiboys ,

    You can use a copy activity with just an additional column. Source dataset can point to any dummy file with one column or dummy table.

    In the mappings tab you can remove the dummy column and have the additional column written to sink.

    Please write to us if you need more help on this.


0 additional answers

Sort by: Most helpful