Azure HDInsight
An Azure managed cluster service for open-source analytics.
214 questions
HDInsight cluster is failing when upgrading the version to 4.0
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 24%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED6%3C/text%3E%3C/svg%3E)
DhosewanKajol-6842
1
Reputation point
Hi Team,
I am getting this error :
Operation on target Txxxxxx failed: Hadoop job failed with exit code '2'. See 'wasbs://adfjobs@sc1admadstg01.blob.core.windows.net/HiveQueryJobs/c269912c-700d-4907-a4d9-4e51ae0096ca/02_08_2021_06_47_21_708/Status/stderr' for more details. Alternatively, open the Ambari UI on the HDI cluster and find the logs for the job 'job_1627886449866_0002'. Contact HDInsight team for further support.
this error is random and usually happens when i manually run the pipeline.
HDinsight cluster creates the cluster but i guess then it fails while running hive query.
the pipeline runs successfully at 3.6 version of HDInsight cluster Linked Service and it gives the above mentioned error when i upgrade the version to 4.0.
{count} votes
-
DhosewanKajol-6842 1 Reputation point
2021-08-03T06:09:10.877+00:00 @Azure-hdinsight @azure-hdinsight-rserver please let me know if you need any other details
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft 19,476 Reputation points Microsoft Employee2021-08-03T23:04:16.123+00:00 Hello @Anonymous ·,
Thanks for the patience , unfortunately we are not getting the kind of response from the team here . if you have a support plan you may file a support ticket, else could you please send an email to azcommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter.
Subscription ID:
Subject : Attn Himanshu
Please let me know once you have done the same. -
DhosewanKajol-6842 1 Reputation point
2021-08-06T10:41:42.763+00:00 HI Himanshu,
i have mailed you with required details.
-
DhosewanKajol-6842 1 Reputation point
2021-08-09T07:36:11.017+00:00 Hi Team @Azure-HDInsight,
this hive activity in my pipeline is failing due to HDInsight cluster Version upgrade. i have updated the version to 4.0 from 3.6.
when i have tried running the pipeline with version 3.6 it ran successfully. it is failing for version 4.0
-
HimanshuSinha-msft 19,476 Reputation points Microsoft Employee
2021-08-11T01:33:56.677+00:00 Hello @Anonymous ,
Just wanted to check back if you have created the SR # with the Microsoft support , if yes can you please share the SR#.
Thanks
Himanshu -
HimanshuSinha-msft 19,476 Reputation points Microsoft Employee
2021-08-17T15:55:07.117+00:00 Hello @Anonymous ,
Just wanted to check back if you have created the SR # with the Microsoft support , if yes can you please share the SR#.
Thanks
Himanshu -
DhosewanKajol-6842 1 Reputation point
2021-08-18T06:28:40.037+00:00 Hi Himanshu,
I have replied to Ryan's mail with correct subscription id. Can you please look into it.
Thanks,
Kajol
Sign in to comment
Sign in to answer