Azure Batch job creation with ADF pipeline while debug the python script in command line facing issue

Question

Azure Batch job creation with ADF pipeline while debug the python script in command line facing issue

Operation on target ForEach1 failed: Activity failed because an inner activity failed

Error details
Error code
2500
Troubleshooting guide
Failure type
User configuration issue
Details
{"errorCategory":0,"code":"CommandProgramNotFound","message":"The specified command program is not found","details":[{"Name":"Message","Value":"The system cannot find the file specified."}]}
Source

ShaikMaheer-MSFT 30,346 Reputation points Microsoft Employee

2021-09-09T06:03:20.817+00:00

Hi @shweta kumari ,

Welcome to Microsoft Q&A Platform. Thank you for posting query here.

It will be hard without know which activity exactly throwing this error and all configuration details of that activity to repro and come to conclusion.

Still, by seeing error message it seems some where system is trying to look for a file but unfortunately its not able find it.

Could you please share details of activity throwing error along with configurations of that activity? Detailed steps you followed from starting to the error will help us better to repro scenario and debug for resolution.
HimanshuSinha-msft 18,536 Reputation points Microsoft Employee

2021-09-09T16:52:39.347+00:00

Hello @shweta kumari ,
Adding to what @ShaikMaheer-MSFT said , you should have more detail message on the blob . Please have a look on the below thread .
https://learn.microsoft.com/en-us/answers/questions/526903/index.html

Thanks
Himanshu
shweta kumari 6 Reputation points

2021-09-12T14:14:05.407+00:00

Thanks for your response Himanshu

Actually, I am trying to run a batch job through the ADF batch services but when i am run with python script its stay running Also I am flowing these documents
https://learn.microsoft.com/en-us/azure/batch/tutorial-run-python-batch-azure-data-factory

as it is menstion
ShaikMaheer-MSFT 30,346 Reputation points Microsoft Employee

2021-09-17T12:15:39.007+00:00

Hello @shweta kumari ,

Looks intermittent issue. Did you tried to cancel execution and retry? If issue still exists?
ShaikMaheer-MSFT 30,346 Reputation points Microsoft Employee

2021-09-21T09:28:01.99+00:00

Hello @shweta kumari ,

Did you get chance to try above commented and share updates?
Aalok Gupta 1 Reputation point

2021-10-25T21:08:07.993+00:00

Did you get resolution to this issue? I am facing the same issue while invoking Azure Batch pool to execute python script through ADF.
saravana kumar 1 Reputation point

2021-12-30T10:36:56.303+00:00

HI @shweta kumari ,
I'm stuck with the same issue, have u got the solution?, if yes plz share it!!??
Nicholas Radich 1 Reputation point

2022-04-29T00:01:51.017+00:00

Hi @ShaikMaheer-MSFT @HimanshuSinha-msft ,
I am running into this issue and am following the example doc.
My data factory can navigate the given ADLS, but it cannot see the specific python file, or any file for that matter (txt,csv).

I am producing both stdout.txt and stderr.txt when trying to debug the pipeline.

I am utilizing an account key for ADF to link to the ADLS. All resources are within the same region.

ShaikMaheer-MSFT 30,346 Reputation points Microsoft Employee

2021-09-09T06:03:20.817+00:00

Hi @shweta kumari ,

Welcome to Microsoft Q&A Platform. Thank you for posting query here.

It will be hard without know which activity exactly throwing this error and all configuration details of that activity to repro and come to conclusion.

Still, by seeing error message it seems some where system is trying to look for a file but unfortunately its not able find it.

Could you please share details of activity throwing error along with configurations of that activity? Detailed steps you followed from starting to the error will help us better to repro scenario and debug for resolution.
HimanshuSinha-msft 18,536 Reputation points Microsoft Employee

2021-09-09T16:52:39.347+00:00

Hello @shweta kumari ,
Adding to what @ShaikMaheer-MSFT said , you should have more detail message on the blob . Please have a look on the below thread .
https://learn.microsoft.com/en-us/answers/questions/526903/index.html

Thanks
Himanshu
shweta kumari 6 Reputation points

2021-09-12T14:14:05.407+00:00

Thanks for your response Himanshu

Actually, I am trying to run a batch job through the ADF batch services but when i am run with python script its stay running Also I am flowing these documents
https://learn.microsoft.com/en-us/azure/batch/tutorial-run-python-batch-azure-data-factory

as it is menstion
ShaikMaheer-MSFT 30,346 Reputation points Microsoft Employee

2021-09-17T12:15:39.007+00:00

Hello @shweta kumari ,

Looks intermittent issue. Did you tried to cancel execution and retry? If issue still exists?
ShaikMaheer-MSFT 30,346 Reputation points Microsoft Employee

2021-09-21T09:28:01.99+00:00

Hello @shweta kumari ,

Did you get chance to try above commented and share updates?
Aalok Gupta 1 Reputation point

2021-10-25T21:08:07.993+00:00

Did you get resolution to this issue? I am facing the same issue while invoking Azure Batch pool to execute python script through ADF.
saravana kumar 1 Reputation point

2021-12-30T10:36:56.303+00:00

HI @shweta kumari ,
I'm stuck with the same issue, have u got the solution?, if yes plz share it!!??
Nicholas Radich 1 Reputation point

2022-04-29T00:01:51.017+00:00

Hi @ShaikMaheer-MSFT @HimanshuSinha-msft ,
I am running into this issue and am following the example doc.
My data factory can navigate the given ADLS, but it cannot see the specific python file, or any file for that matter (txt,csv).

I am producing both stdout.txt and stderr.txt when trying to debug the pipeline.

I am utilizing an account key for ADF to link to the ADLS. All resources are within the same region.