How to fix this error in azure data factory? My dataflow worked fine, now I receive this error.

Fatemeh Ghorbani Sini 0

Error:

Spark job failed: { "text/plain": "{"runId":"83899cfc-c2ab-4e94-a1fa-89e1d3bd2a4c","sessionId":"6e0c1f32-a0c9-47d5-9baf-50f0e4228498","status":"Failed","payload":{"statusCode":400,"shortMessage":"DF-SYS-0 Failure(java.lang.Exception: DfmTokenFetcher parse DFM Token failed, response payload is .) (of class scala.util.Failure)","detailedMessage":"Failure 2024-05-03 14:01:02.302 failed DebugManager.processJob, run=83899cfc-c2ab-4e94-a1fa-89e1d3bd2a4c, errorMessage=DF-SYS-0 Failure(java.lang.Exception: DfmTokenFetcher parse DFM Token failed, response payload is .) (of class scala.util.Failure)"}}\n" } - RunId: 83899cfc-c2ab-4e94-a1fa-89e1d3bd2a4c

phemanth 6,550 Reputation points Microsoft Vendor

2024-05-03T15:19:16.0666667+00:00
@Fatemeh Ghorbani Sini

Thanks for using MS Q&A platform and posting your query.

The error message indicates an issue with the authentication token used by your Spark job to access the data flow. Here's a breakdown of the error and some troubleshooting steps:

Error Message:

DF-SYS-0 Failure: This signifies a system-level failure within the Data Flow Management system.

java.lang.Exception: DfmTokenFetcher parse DFM Token failed, response payload is .: This is the core of the problem. The system couldn't parse the Data Flow Management (DFM) token, likely due to an empty or invalid response.

Troubleshooting Steps:

Refresh Authentication Token: The most common cause is an expired token. Try refreshing the authentication token used by your Spark job. Refer to your specific platform's documentation for instructions on refreshing tokens.

Verify Token Validity: Ensure the token you're using is valid and has the necessary permissions to access the data flow. Check for any typos or configuration mistakes in the token generation process.

Connectivity Test: Use a separate tool like Postman to test connectivity to the data flow resources (source and destination) with the same credentials. This helps isolate if the issue is with the token itself or the communication between your Spark job and the data flow service.

Check Logs: Look for more detailed error messages in the logs associated with your Spark job execution. These logs might provide additional clues about the cause of the token parsing failure

please refer https://learn.microsoft.com/en-us/azure/data-factory/data-flow-troubleshoot-guide

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Fatemeh Ghorbani Sini 0 Reputation points

2024-05-03T15:48:21.6766667+00:00

Thank you for your reply. I am completely new to these subjects. Can you please explain in simple terms? Where should I find authentication token?
phemanth 6,550 Reputation points Microsoft Vendor

2024-05-07T13:22:08.3233333+00:00

Hi @Fatemeh Ghorbani Sini

could you please more details such as data flow configuration and exact requirement that you want to achieve, and screen shots if possible.
phemanth 6,550 Reputation points Microsoft Vendor

2024-05-08T07:02:26.8533333+00:00

@Fatemeh Ghorbani Sini We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Share via

How to fix this error in azure data factory? My dataflow worked fine, now I receive this error.