Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,363 questions
How to fix error Job failed due to reason: com.microsoft.dataflow.broker.InvalidPayload
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 17%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDB%3C/text%3E%3C/svg%3E)
Dhruva B
50
Reputation points
Operation on target Country failed: {"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: com.microsoft.dataflow.broker.InvalidPayloadException: Fail to validate with reason: Retry Request, fail to reach https://ne.frontend.clouddatahub.net/subscriptions/20dfa616-a010-44c9-a6cb-921210d94a45/datafactories/5482b688-037f-44f2-83a9-176081c5938f/securityValidation/validatePayload?api-version=2022-08-01 with with code: 500
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT 27,156 Reputation points Microsoft Employee2024-04-29T16:28:03.2733333+00:00 Hello Dhruva B,
From the error message(
500error code), in general it indicates the server side issue.Could you please confirm if this error occurs intermittently, or if it happens every time you run the pipeline?
Additionally, could you check Azure Monitor to see if any outages might have triggered this error?
-
Dhruva B 50 Reputation points
2024-04-30T05:07:58.3033333+00:00 Yes it is true it refers for Internal Server error, but the thing is we are experiencing it frequently from past 2 weeks. Even yesterday we faced many issues in multiple data factory.
If one job failed then in relaunch it would complete but some other job gets failed, so had to check in community how we could overcome this.
-
Dhruva B 50 Reputation points
2024-04-30T05:10:05.73+00:00 Until last month it was an intermittent issue but recently the count has increased, especially in last 2 weeks we are getting 5+ issues in a week.
-
BhargavaGunnam-MSFT 27,156 Reputation points Microsoft Employee
2024-04-30T15:54:52.89+00:00 Dhruva B ,
Thanks for the additional details. We noticed a similar issue in North Europe some time ago due to some backend servers becoming unstable and randomly dropping requests.
I suggest opening a support case so that a support engineer can collect more details and involve the product group. If you don't have a support plan, please let me know so that I can enable a one-time free support request to work on this case.
I'm looking forward to hearing from you.
Sign in to comment