question

RamyaHarinarthini-MSFT avatar image
0 Votes"
RamyaHarinarthini-MSFT asked PRADEEPCHEEKATLA-MSFT edited

How to Change Apache Hadoop MapReduce memory settings in HDInsight R Server cluster?

How to Change Apache Hadoop MapReduce memory settings in HDInsight R Server cluster?

[Note: As we migrate from MSDN, this question has been posted by an Azure Cloud Engineer as a frequently asked question]


Sourced from Docs - Azure HDInsight R Server


azure-hdinsight-rserver
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

PRADEEPCHEEKATLA-MSFT avatar image
0 Votes"
PRADEEPCHEEKATLA-MSFT answered PRADEEPCHEEKATLA-MSFT edited

Welcome to the Microsoft Q&A platform.

Happy to answer your questions.

To Change Apache Hadoop MapReduce memory settings:

Available memory to ML Services can be modified when it's running a MapReduce job. To modify a cluster, use the Apache Ambari UI for your cluster. For Ambari UI instructions, see Manage HDInsight clusters using the Ambari Web UI.

Available memory to ML Services can be changed by using Hadoop switches in the call to RxHadoopMR:

     hadoopSwitches = "-libjars /etc/hadoop/conf -Dmapred.job.map.memory.mb=6656"   

Reference: Azure HDinsight – R Server Overview

Hope this helps.

Sourced from Docs - Azure HDInsight R Server





5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.