Share via

How to Change Apache Hadoop MapReduce memory settings in HDInsight R Server cluster?

Ramya Harinarthini_MSFT 5,351 Reputation points Microsoft Employee
2020-05-14T07:46:53.357+00:00

How to Change Apache Hadoop MapReduce memory settings in HDInsight R Server cluster?

[Note: As we migrate from MSDN, this question has been posted by an Azure Cloud Engineer as a frequently asked question]

Sourced from Docs - Azure HDInsight R Server

Azure R Server for HDInsight
Azure R Server for HDInsight
An Azure service that provides predictive analytics, machine learning, and statistical modeling for big data.
13 questions
0 comments
Accepted answer
  1. PRADEEPCHEEKATLA 90,241 Reputation points
    2020-05-14T07:49:59.197+00:00

    Welcome to the Microsoft Q&A platform.

    Happy to answer your questions.

    To Change Apache Hadoop MapReduce memory settings:

    Available memory to ML Services can be modified when it's running a MapReduce job. To modify a cluster, use the Apache Ambari UI for your cluster. For Ambari UI instructions, see Manage HDInsight clusters using the Ambari Web UI.

    Available memory to ML Services can be changed by using Hadoop switches in the call to RxHadoopMR: 

        hadoopSwitches = "-libjars /etc/hadoop/conf -Dmapred.job.map.memory.mb=6656"

    Reference: Azure HDinsight – R Server Overview

    Hope this helps.

    Sourced from Docs - Azure HDInsight R Server

    0 comments

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.