synapse pipelines - failure activity

arkiboys 9,701 Reputation points
2021-08-04T06:37:45.997+00:00

Hello,
I would like to start introducing the failure activity into the synapse pipelines.
For example, when an activity fails then it goes into the failure activity...
Question:
As our current destination(Sink) are .parquet files into blob storage, how should I structure the failures?
For example, if I create a folder called "Errors" in the blob storage, then should the errors be created in .parquet as same as other files?

Thank you

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,173 questions
{count} votes

Accepted answer
  1. arkiboys 9,701 Reputation points
    2021-08-05T06:20:12.043+00:00

    Yes, on failure dependency.
    In your example, instead of copy data1, I would like t o have an activity to populate .parquet file.
    What activity do I use?
    Thank you


1 additional answer

Sort by: Most helpful
  1. arkiboys 9,701 Reputation points
    2021-08-19T07:38:25.643+00:00

    Thank you for the details

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.