Hello,
I am facing an intermitting error when using a file system dataset, configured to connect to a Self-Hosted Integration Runtime (SHIR). When I connect to the virtual machine, I usually get no error if I run the pipeline using the dataset, but if I run the pipeline after some time I have not logged into the VM, I get the following error in the pipeline:
Error code: 2011
Failure type: User configuration issue
Details: Error occurred when trying to access the file in Folder '\path\to\local\filesystem', File filter: '*'.
Some details on the virtual machine for the SHIR:
The ADF pipeline first lists the files in a directory and then it loops on the list to copy them to data lake. I get the failure while listing the files (Get Metadata activity).
In the Event Viewer on the virtual machine, I get these kind of events:
- <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
- <System>
<Provider Name="Integration Runtime (Self-hosted) Connectors" />
<EventID Qualifiers="0">30000</EventID>
<Version>0</Version>
<Level>2</Level>
<Task>0</Task>
<Opcode>0</Opcode>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2025-01-21T10:13:00.3342564Z" />
<EventRecordID>1460082</EventRecordID>
<Correlation />
<Execution ProcessID="0" ThreadID="0" />
<Channel>Connectors – Integration Runtime</Channel>
<Computer>vm.com.local</Computer>
<Security />
</System>
- <EventData>
<Data>TraceComponentId: ExecutionTask TraceMessageId: ExecutionTaskCommon @logId: Error FunctionName: ExecutionTask jobId: 5dff4f23-ff29-4925-8aff-bab79345cec8 activityId: 5dff4f23-ff29-4925-8aff-bab79345cec8 eventId: ExecutionTaskCommon message: Execution failed. Error message: 'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Error occurred when trying to access the file in Folder ''\\path\to\local\filesystem', File filter: '*'.,Source=Microsoft.DataTransfer.ClientLibrary,StackTrace= at Microsoft.DataTransfer.ClientLibrary.FileSourceHelper.EnumerateDirectory(DirectoryInfo dirInfo, String fileSearchPattern, Boolean recursive, Boolean fileOnly) at Microsoft.DataTransfer.ClientLibrary.AuthorizedOnPremiseFileReader.EnumerateDirectoryWithUserContext(DirectoryInfo directoryInfo, String searchPattern, Boolean recursive, Boolean fileOnly) at Microsoft.DataTransfer.ClientLibrary.AuthorizedOnPremiseFileReader.EnumerateDirectoryWithErrorHandling(DirectoryInfo directoryInfo, String searchPattern, Boolean recursive, Boolean fileOnly) at Microsoft.DataTransfer.ClientLibrary.AuthorizedOnPremiseFileReader.<>c__DisplayClass33_0.<EnumerateDirectory>b__0() at System.Threading.Tasks.Task.Execute(),''Type=System.IO.IOException,Message=The network path was not found. ,Source=mscorlib,StackTrace= at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileSystemEnumerableIterator`1.CommonInit() at System.IO.FileSystemEnumerableIterator`1..ctor(String path, String originalUserPath, String searchPattern, SearchOption searchOption, SearchResultHandler`1 resultHandler, Boolean checkHost) at System.IO.DirectoryInfo.EnumerateFileSystemInfos(String searchPattern, SearchOption searchOption) at Microsoft.DataTransfer.ClientLibrary.FileSourceHelper.EnumerateDirectory(DirectoryInfo dirInfo, String fileSearchPattern, Boolean recursive, Boolean fileOnly),'</Data>
</EventData>
</Event>
I am investigating this issue with the IT department to understand if there is any issue with the firewall or other network-related problems.
Has anyone experienced similar issues? Could this be an issue with the integration runtime and the Windows VM configuration, or is it a Data Factory issue?