Run R script on ADF

Question

Run R script on ADF

Prakash14 126

i have a very small R script which needs to be run in ADF. What is the ideal solution for this ? Azure batch /Azure Function /Azure automation account /vm's(VM is existing and not new, how to connect vm's from ADF and execute R file). I got to know R language is not supported in Azure functions. Azure function alone is serverless ?Help me choose the right service for this.

PRADEEPCHEEKATLA 91,656 Reputation points Moderator

2022-09-08T08:28:40.69+00:00
Hello @Prakash14 ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.

1 answer

Your answer

PRADEEPCHEEKATLA 91,656 Reputation points Moderator

2022-09-08T08:28:40.69+00:00

Hello @Prakash14 ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.

Answer 1

Nandan Hegde 36,716 MVP Volunteer Moderator

The below doc should help :
https://github.com/Azure/Azure-DataFactory/blob/main/SamplesV2/tutorial-run-r-batch-azure-data-factory/tutorial-run-r-batch-azure-data-factory.md

Prakash14 126 Reputation points

2022-08-29T15:38:31.093+00:00

Is it possible to use existing VM's instead of new Batch VM's ? Also how to run r scripts from Azure functions serverless ?
Nandan Hegde 36,716 Reputation points MVP Volunteer Moderator

2022-08-30T06:06:06.913+00:00
you cannot run R scripts in Azure functions as per my understanding.

I am not exactly sure whether the below approach would work but just a thought:

Set up Azure devops agent in that VM

create a release pipeline in Azure devops

Set up logic app to trigger Devops pipeline

Trigger logic app from ADF

The above flow is just a hypothetical flow and not sure that would work exactly .
Prakash14 126 Reputation points

2022-08-31T16:31:18.293+00:00

Getting the below error when using Azure batch commands on ADF Using the DSVM image.

1.Command - Rscript file.R

Error : Task failed "The specified command program is not found"

2.Command - cmd /c Rscript file.R

'Rscript' is not recognized as an internal or external command,
operable program or batch file.
PRADEEPCHEEKATLA 91,656 Reputation points Moderator

2022-09-05T14:22:01.847+00:00

Hello @Prakash14 ,

It will be hard without know which activity exactly throwing this error and all configuration details of that activity to repro and come to conclusion.

Still, by seeing error message it seems some where system is trying to look for a file but unfortunately its not able find it.

Could you please share details of activity throwing error along with configurations of that activity? Detailed steps you followed from starting to the error will help us better to repro scenario and debug for resolution.
Eric Zhang 5 Reputation points

2024-07-26T20:55:51.41+00:00

I also had Error : Task failed "The specified command program is not found". As of July 2024 microsoft-dsvm --> dsvm-windows --> server-2016 shown on the above Github page is no longer available. The only offer for microsoft-dsvm is ubuntu-hpc of sku 2204, on which R is not installed. How to installed R on microsoft-dsvm --> ubuntu-hpc --> 2204? Or even better, is there a pool image that comes with R installed?

Share via

Run R script on ADF

1 answer

Your answer