Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
How to fix error Job failed due to reason: com.microsoft.dataflow.broker.InvalidPayload
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 17%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDB%3C/text%3E%3C/svg%3E)
Dhruva B
50
Reputation points
Operation on target Country failed: {"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: com.microsoft.dataflow.broker.InvalidPayloadException: Fail to validate with reason: Retry Request, fail to reach https://ne.frontend.clouddatahub.net/subscriptions/20dfa616-a010-44c9-a6cb-921210d94a45/datafactories/5482b688-037f-44f2-83a9-176081c5938f/securityValidation/validatePayload?api-version=2022-08-01 with with code: 500
Azure Data Lake Storage
Azure Storage
Azure Storage
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator2024-04-29T16:28:03.2733333+00:00 Hello Dhruva B,
From the error message(
500error code), in general it indicates the server side issue.Could you please confirm if this error occurs intermittently, or if it happens every time you run the pipeline?
Additionally, could you check Azure Monitor to see if any outages might have triggered this error?
-
Dhruva B 50 Reputation points
2024-04-30T05:07:58.3033333+00:00 Yes it is true it refers for Internal Server error, but the thing is we are experiencing it frequently from past 2 weeks. Even yesterday we faced many issues in multiple data factory.
If one job failed then in relaunch it would complete but some other job gets failed, so had to check in community how we could overcome this.
-
Dhruva B 50 Reputation points
2024-04-30T05:10:05.73+00:00 Until last month it was an intermittent issue but recently the count has increased, especially in last 2 weeks we are getting 5+ issues in a week.
-
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator
2024-04-30T15:54:52.89+00:00 Dhruva B ,
Thanks for the additional details. We noticed a similar issue in North Europe some time ago due to some backend servers becoming unstable and randomly dropping requests.
I suggest opening a support case so that a support engineer can collect more details and involve the product group. If you don't have a support plan, please let me know so that I can enable a one-time free support request to work on this case.
I'm looking forward to hearing from you.
Sign in to comment
Sign in to answer