Azure data factory Pipeline failing with Dll missing error

Shri Gowtham Tharun Reddy Abbireddy 146 Reputation points
2023-02-16T12:11:48.4633333+00:00

After Self hosted integration runtime update today. Our pipeline is failing with the below error: We have the dll in the folder. Unable to identify the error

DetailsOperation on target Copy data-SNF-Structured failed: 'Type=System.IO.FileNotFoundException,Message=Could not load file or assembly 'Microsoft.IdentityModel.Tokens, Version=6.15.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. The system cannot find the file specified.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.IO.FileNotFoundException,Message=Could not load file or assembly 'Microsoft.IdentityModel.Tokens, Version=5.4.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. The system cannot find the file specified.,Source=mscorlib,''Type=System.IO.FileNotFoundException,Message=Could not load file or assembly 'file:///C:\Program Files\Microsoft Integration Runtime\5.0\Gateway\Microsoft.IdentityModel.Tokens.dll' or one of its dependencies. The system cannot find the file specified.,Source=mscorlib,'

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,646 questions
{count} votes

Accepted answer
  1. AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator
    2023-02-21T11:50:09.8966667+00:00

    Hi Shri Gowtham Tharun Reddy Abbireddy ,

    We have determined an old code bug in Selfhosted Integration runtime that results in some configuration files not refreshed in Selfhosted Integration runtime upgrade. This introduces possible incorrect dynamic binding which causes above failure.

    The hotfix SHIRs based on 5.25 ~ 5.27 with the fix has been released. You can manually update to these versions (directly update and don't need to uninstall).

    Mitigation:

    Manually update to below hotfix versions accordingly or wait for auto update:

    https://download.microsoft.com/download/E/4/7/E4771905-1079-445B-8BF9-8A1A075D8A10/IntegrationRuntime_5.25.8410.1.msi

    https://download.microsoft.com/download/E/4/7/E4771905-1079-445B-8BF9-8A1A075D8A10/IntegrationRuntime_5.26.8424.2.msi

    https://download.microsoft.com/download/E/4/7/E4771905-1079-445B-8BF9-8A1A075D8A10/IntegrationRuntime_5.27.8441.3.msi

    Or,

    Kindly download the msi files from here: Download Self hosted IR .


    Hope it helps. Please do consider clicking Accept Answer as accepted answers help community as well. Also, please click on Yes for the survey 'Was the answer helpful'

    1 person found this answer helpful.

7 additional answers

Sort by: Most helpful
  1. AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator
    2023-02-17T10:21:56.29+00:00

    Hi Shri Gowtham Tharun Reddy Abbireddy ,

    Thankyou for using Microsoft Q&A platform and thanks for posting your query here.

    As I understand your issue, you are getting a dll related error "Could not load file or assembly" when you are using Self hosted IR and running the ADF pipeline. Please let me know if my understanding is incorrect.

    The cause for occurrence of this error is unavailability of Microsoft.IdentityModel.Tokens.dll file in the following folder path of the system in which Selfhosted IR has been installed: *C:\Program Files\Microsoft Integration Runtime\4.0\Gateway\DataScan *

    Resolution

    • Copy the Microsoft.IdentityModel.Tokens.dll file from *C:\Program Files\Microsoft Integration Runtime\4.0\Gateway\DataScan *subfolder to *C:\Program Files\Microsoft Integration Runtime\4.0\Gateway*folder . If the dll file is not available in DataScan folder then , kindly reinstall the Self hosted IR .

    User's image

    Additional reference: Troubleshooting documentation for Self-hosted IR could not load file or assembly


    Hope it helps. Please do consider clicking Accept Answer as accepted answers help community as well. Also, please click on Yes for the survey 'Was the answer helpful'


  2. GOURIET Davy 0 Reputation points
    2023-02-17T14:42:52.5066667+00:00

    Hi all,

    I have this problem on ADF with Integration Runtime on premise :

    { "copyDuration": 5, "errors": [ { "Code": 11000, "Message": "'Type=System.IO.FileNotFoundException,Message=Impossible de charger le fichier ou l'assembly 'Microsoft.IdentityModel.Tokens, Version=6.15.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' ou une de ses dépendances. Le fichier spécifié est introuvable.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.IO.FileNotFoundException,Message=Impossible de charger le fichier ou l'assembly 'Microsoft.IdentityModel.Tokens, Version=5.4.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' ou une de ses dépendances. Le fichier spécifié est introuvable.,Source=mscorlib,''Type=System.IO.FileNotFoundException,Message=Impossible de charger le fichier ou l'assembly 'file:///C:\Program Files\Microsoft Integration Runtime\5.0\Gateway\Microsoft.IdentityModel.Tokens.dll' ou une de ses dépendances. Le fichier spécifié est introuvable.,Source=mscorlib,'", "EventType": 0, "Category": 5, "Data": {}, "MsgId": null, "ExceptionType": null, "Source": null, "StackTrace": null, "InnerEventInfos": [] }....

    I have tried your solution but it does not work.

    Any Idea

    0 comments No comments

  3. GOURIET Davy 0 Reputation points
    2023-02-17T14:43:04.3+00:00

    Hi all,

    I have this problem on ADF with Integration Runtime on premise :

    { "copyDuration": 5, "errors": [ { "Code": 11000, "Message": "'Type=System.IO.FileNotFoundException,Message=Impossible de charger le fichier ou l'assembly 'Microsoft.IdentityModel.Tokens, Version=6.15.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' ou une de ses dépendances. Le fichier spécifié est introuvable.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.IO.FileNotFoundException,Message=Impossible de charger le fichier ou l'assembly 'Microsoft.IdentityModel.Tokens, Version=5.4.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' ou une de ses dépendances. Le fichier spécifié est introuvable.,Source=mscorlib,''Type=System.IO.FileNotFoundException,Message=Impossible de charger le fichier ou l'assembly 'file:///C:\Program Files\Microsoft Integration Runtime\5.0\Gateway\Microsoft.IdentityModel.Tokens.dll' ou une de ses dépendances. Le fichier spécifié est introuvable.,Source=mscorlib,'", "EventType": 0, "Category": 5, "Data": {}, "MsgId": null, "ExceptionType": null, "Source": null, "StackTrace": null, "InnerEventInfos": [] }....

    I have tried your solution but it does not work.

    Any Idea ?

    Thanks

    0 comments No comments

  4. Anonymous
    2023-02-20T02:21:23.6466667+00:00

    Seeing this error too. Anyone had any resolution for this issue?


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.