Pipeline outputs files with empty content

Yanan Wang 20 Reputation points Microsoft Employee
2024-06-27T11:13:12.63+00:00

I have a pipeline and it worked well until 6/14. Since 6/15, the pipeline ran successfully and output files with empty content, but I did not modify it. Can anyone help me understand it?

Here is the pipeline: https://ms-adf.azure.com/en/authoring/pipeline/GoogleMetricsGeneration?factory=%2Fsubscriptions%2F4d3820f4-8f40-45c6-95f0-0297ca938f22%2FresourceGroups%2F3PP%2Fproviders%2FMicrosoft.DataFactory%2Ffactories%2F3ppDataPipeline
"jobId": "cf90cd21-319c-4209-afd2-e872348bc7e9"

"jobUrl": "https://deeplinks-c08.azuredatalakeanalytics.net/jobLink/cf90cd21-319c-4209-afd2-e872348bc7e9"

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,749 questions
{count} votes

Accepted answer
  1. Harishga 5,990 Reputation points Microsoft Vendor
    2024-07-02T04:02:37.8333333+00:00

    Hi @Yanan Wang
    Welcome to Microsoft Q&A platform and thanks for posting your question here.

    I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer .

    Ask
    I have a pipeline and it worked well until 6/14. Since 6/15, the pipeline ran successfully and output files with empty content, but I did not modify it. Can anyone help me understand it?

    Here is the pipeline: https://ms-adf.azure.com/en/authoring/pipeline/GoogleMetricsGeneration?factory=%2Fsubscriptions%2F4d3820f4-8f40-45c6-95f0-0297ca938f22%2FresourceGroups%2F3PP%2Fproviders%2FMicrosoft.DataFactory%2Ffactories%2F3ppDataPipeline "jobId": "cf90cd21-319c-4209-afd2-e872348bc7e9"

    "jobUrl": "https://deeplinks-c08.azuredatalakeanalytics.net/jobLink/cf90cd21-319c-4209-afd2-e872348bc7e9"

    Solution
    We reran the pipeline and had the same issue. Since we didn't modify it, we checked the input data and found that it was caused by the change of the upstream data format.

    If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.I hope this helps!

    If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.


    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.