Troubleshoot 'The specified resource does not exist. ' from Azure Data Factory Custom Batch Run

Dan 21

I have a simple "Rscript test.r" batch Command that runs a R script which just prints the message "greetings". When i trigger the pipeline manually and look at the output. It says:

<Error>
<Code>ResourceNotFound</Code>
<Message>The specified resource does not exist. RequestId:9bd49bcf-601e-00ec-2bed-4f9f4a000000 Time:2020-07-01T21:18:30.7051260Z</Message>
</Error>

Now, i have verified that the R script i am trying to run is in the Storage Account container and the right folder is selected. Also the connections to the batch service and the storage service work.

Where could i go to get more information for this error?

Does this error mean that the R script i am trying to run doesn't exist or that the Rscript program does not exist or it can't be found.

I even used RDP to log into the node and verified that Rscript binary and it's containing folder is on the System Path. And that i can run a simple test script i wrote locally.

KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee

2020-07-02T22:32:08.663+00:00

Hi @Dan ,

Welcome to Microsoft Q&A platform and thank you for your query.

It seems to be a configuration issue. To provide a better assistance, could you please share your failed pipeline run ID, failed activity run ID, your data factory region and a screenshot of your activity settings configuration and the script. These details would help us to narrow down the root cause analysis.

--------
Thanks
Dan 21 Reputation points

2020-07-06T17:18:16.207+00:00

Hi @KranthiPakala-MSFT , thanks for your reply. Here are the details you asked for:

Run ID: 41c67980-8ed7-4260-a21a-aae6ec84c076
Pipeline run ID: d5958432-6d5e-435d-9d83-7a5d978cd9f7
Region: East US

The R script only has this line in it:
print('greetings')

Here are the activity settings:
Dan 21 Reputation points

2020-07-06T20:05:22.03+00:00

I was able to figure out that the R script actually runs successfully. When i looked up the Run ID in the Azure Tasks view in the respective Job. I was able to see the output file. So it seems that from the Data Factory pipeline custom Batch Service view after i click debug. When i click on the stdout.txt link, i do not have access to that file. This could be a bug in Azure Portal. I have attached a screenshot of where the link is that does not give me access to the stdout.txt file. This is not a permission issue, since i can access this file when i click on it from the Job Tasks view. Since i did not know about that Tasks view this led me to think that there was an access issue connecting the datafactory pipeline to the storage account.
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee

2020-07-06T22:32:34.947+00:00

Hi @Dan-8327,

Thanks for your response and additional details. From the logs I see that your activity run succeeded and hence the pipeline. But now you are having issue accessing stdout.txt file using the link provided in activity run details - is that correct?

Could you please confirm if you were able to access the file from Azure Portal (storage account) or Microsoft Azure Storage Explorer?

Please correct me if my understanding is incorrect.

Thanks
Dan 21 Reputation points

2020-07-06T23:13:13.963+00:00

Hi @KranthiPakala-MSFT

Yeah, once i click debug and then click on the output icon. In the dialog box that comes up, i click on the stdout.txt link and it shows an XML Resource does not exist error.

I can however access the file through the Storage Account or the Microsoft Azure Storage Explorer.

I am ok since there are alternatives to access the output and error files. I just think this might be a bug.
KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee

2020-07-13T20:27:54.157+00:00

Hi @Dan-8327,

Apologies for the delay in my response. I have escalated this to internal team to further review and awaiting a response. I'll keep you posted a soon as I have an update from the team. Apologies for the inconvenience.

Thank you
Patrick GRANDJEAN 1 Reputation point

2021-01-20T22:03:21.417+00:00

Same problem. Any way to fix this?