PrepAway - Latest Free Exam Questions & Answers

What is the result when you execute: hadoop jar samplejar.jar MyClass on a client machine?

Your cluster is configured with HDFS and MapReduce version 2 (MRv2) on YARN. What is the
result when you execute: hadoop jar samplejar.jar MyClass on a client machine?

PrepAway - Latest Free Exam Questions & Answers

A.
SampleJar.jar is sent to the ApplicationMaster which allocation a container for Sample.jar

B.
SampleJar.Jar is serialized into an XML file which is submitted to the ApplicationMaster

C.
SampleJar.Jar is sent directly to the ResourceManager

D.
SampleJar.Jar is placed in a temporary directly in HDFS

3 Comments on “What is the result when you execute: hadoop jar samplejar.jar MyClass on a client machine?

  1. John says:

    Can’t be A – since its Resource Manager that allocates an ApplicationMaster to run.
    It should be “D” since thats the default process for MRv1. Once stored in HDFS – the ResourceManager is notified of it, who then informs the ApplicationMasters, who then negotiate the NodeManagers to actually run the map and reduce functions within the Jar (all shared via HDFS)




    0



    0
  2. as says:

    You run the job on client by using hadoop jar command in which you pass jar file name, class name and other parameters such as input and output
    Client will get new application id and then it will copy the jar file and other job resources to HDFS with high replication factor (by default 10 on large clusters)
    Then Client will actually submit the application through resource manager
    Resource manager keeps track of cluster utilization and submit application master (which co-ordinates the job execution)
    Application master will talk to namenode and determine where the blocks for input are located and then work with nodemanagers to submit the tasks (in the form of containers)
    Containers are nothing but JVMs and they run map and reduce tasks (mapper and reducer classes), when the JVM is bootstrapped job resources that are on HDFS will be copied to the JVM. For mappers these JVMs will be created on same nodes on which data exists. Once the processing is started the jar file will be executed to process the data locally on that machine (typical).




    0



    0

Leave a Reply

Your email address will not be published. Required fields are marked *