PrepAway - Latest Free Exam Questions & Answers

Which process instantiates user code, and executes map and reduce tasks on a cluster running MapReduce v2 (MRv

Which process instantiates user code, and executes map and reduce tasks on a cluster running
MapReduce v2 (MRv2) on YARN?

PrepAway - Latest Free Exam Questions & Answers

A.
NodeManager

B.
ApplicationMaster

C.
TaskTracker

D.
JobTracker

E.
NameNode

F.
DataNode

G.
ResourceManager

15 Comments on “Which process instantiates user code, and executes map and reduce tasks on a cluster running MapReduce v2 (MRv

  1. Dev says:

    B seems to be the correct answer as YarnChild is executed on request from ApplicationMaster. where as runJar is Application master.

    [hduser@cdh-master ~]$ jps
    15338 NameNode
    19939 YarnChild
    15808 ResourceManager
    20209 Jps
    15651 SecondaryNameNode
    19039 RunJar
    19365 MRAppMaster
    19918 YarnChild
    5634 JobHistoryServer
    19892 YarnChild
    19893 YarnChild
    20015 YarnChild
    19959 YarnChild
    15466 DataNode
    15908 NodeManager




    0



    0
  2. Trung Phan says:

    I don’t think Application Master (AM) is correct answer, because, AM coordinates Tasks running the MR Job. AM and MR Tasks run in Containers what scheduled by Resource Manager and managed by NMs.

    from the book “The Definitive Guide 4th Edition”

    Figure 7-1: How Hadoop runs a MapReduce job

    Task Execution:

    Once a task has been assigned resources for a container on a particular node by the
    resource manager’s scheduler, the application master starts the container by contacting
    the node manager.
    The task is executed by a Java application whose main class is YarnChild.
    Before it can run the task, it localizes the resources that the task needs, including the job configuration and JAR file, and any files.
    Finally, it runs the map or reduce task.




    0



    0
  3. abc says:

    From cloudera training doc

    NodeManager
    – Manages life/cycle of containers
    – Launches Map and Reduce tasks in containers
    – Monitors resource consumption




    0



    0
  4. Debu Saha says:

    Correct answer is G – Resource Manager

    http://www.aiotestking.com/cloudera/which-process-instantiates-user-code-and-executes-map-and-reduce-tasks-on-a-cluster-running-mapreduce-v2-mrv2-on-yarn/

    The MapReduce Job Lifecycle in YARN

    User submits an app request by passing config for Application Manager to Resource Manager.
    1. Resource Manager allocates a container for Application Manager on a node. Tells Node Manager in charge of that node to launch the Application Manager container.
    2. Application Manager registers back with Resource Manager. Asks for more containers to run tasks.
    3. Resource Manager allocates the containers on different nodes in the cluster.
    4.. Application Manager talks directly to the Node Managers on those nodes to launch the containers for tasks.
    5.Application Manager monitors the progress of the tasks.
    6. When all the application’s tasks are done, Application Manager unregisters itself from Resource Manager.
    7. Resource Manager reclaims the previously allocated containers for the application




    0



    0

Leave a Reply

Your email address will not be published. Required fields are marked *