synapse pipelines - failure activity

arkiboys 9,666 Reputation points
2021-08-04T06:37:45.997+00:00

Hello,
I would like to start introducing the failure activity into the synapse pipelines.
For example, when an activity fails then it goes into the failure activity...
Question:
As our current destination(Sink) are .parquet files into blob storage, how should I structure the failures?
For example, if I create a folder called "Errors" in the blob storage, then should the errors be created in .parquet as same as other files?

Thank you

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,484 questions
{count} votes

Accepted answer
  1. arkiboys 9,666 Reputation points
    2021-08-05T06:20:12.043+00:00

    Yes, on failure dependency.
    In your example, instead of copy data1, I would like t o have an activity to populate .parquet file.
    What activity do I use?
    Thank you


1 additional answer

Sort by: Most helpful
  1. arkiboys 9,666 Reputation points
    2021-08-19T07:38:25.643+00:00

    Thank you for the details

    0 comments No comments