How to Change Apache Hadoop MapReduce memory settings in HDInsight R Server cluster?

Ramya Harinarthini_MSFT 5,306 Reputation points Microsoft Employee
2020-05-14T07:46:53.357+00:00

How to Change Apache Hadoop MapReduce memory settings in HDInsight R Server cluster?

[Note: As we migrate from MSDN, this question has been posted by an Azure Cloud Engineer as a frequently asked question]

Sourced from Docs - Azure HDInsight R Server

Azure R Server for HDInsight
Azure R Server for HDInsight
An Azure service that provides predictive analytics, machine learning, and statistical modeling for big data.
13 questions
0 comments
Accepted answer
  1. PRADEEPCHEEKATLA-MSFT 76,921 Reputation points Microsoft Employee
    2020-05-14T07:49:59.197+00:00

    Welcome to the Microsoft Q&A platform.

    Happy to answer your questions.

    To Change Apache Hadoop MapReduce memory settings:

    Available memory to ML Services can be modified when it's running a MapReduce job. To modify a cluster, use the Apache Ambari UI for your cluster. For Ambari UI instructions, see Manage HDInsight clusters using the Ambari Web UI.

    Available memory to ML Services can be changed by using Hadoop switches in the call to RxHadoopMR: 

        hadoopSwitches = "-libjars /etc/hadoop/conf -Dmapred.job.map.memory.mb=6656"

    Reference: Azure HDinsight – R Server Overview

    Hope this helps.

    Sourced from Docs - Azure HDInsight R Server

    0 comments

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest