Integrate Batch Service with DataFactory pipeline and schedule weekly run

Toto Meghwar 21 Reputation points
2022-03-29T05:44:53.593+00:00

187747-error-2508.png

Getting above error while rerunning same pipeline in data Factory. Even after changing the destination, it throughs same error 2508.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,466 questions
Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
330 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,666 questions
0 comments No comments
{count} votes

Accepted answer
  1. Pratik Somaiya 4,206 Reputation points
    2022-03-29T06:04:08.85+00:00

    Hello @Toto Meghwar

    Custom activities flatten folder structure under folderPath. If you need to preserve the folder structure, zip the files and extract them in Azure Batch by using an unzip command

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.