You want to run Hadoop jobs on your development workstation for testing before you submit them
to your production cluster. Which mode of operation in Hadoop allows you to most closely simulate
a production cluster while using a single machine?
A.
Run all the nodes in your production cluster as virtual machines on your development
workstation.
B.
Run the hadoop command with the –jt local and the –fs file:///options.
C.
Run the DataNode, TaskTracker, NameNode and JobTracker daemons on a single machine.
D.
Run simldooop, the Apache open-source software for simulating Hadoop clusters.
Explanation:
Hosting on local VMs
As well as large-scale cloud infrastructures, there is another deployment pattern: local VMs on
desktop systems or other development machines. This is a good tactic if your physical machines
run windows and you need to bring up a Linux system running Hadoop, and/or you want to
simulate the complexity of a small Hadoop cluster.
Have enough RAM for the VM to not swap.
Don’t try and run more than one VM per physical host, it will only make things slower.
use file: URLs to access persistent input and output data.
consider making the default filesystem a file: URL so that all storage is really on the physical host.
It’s often faster and preserves data better.
shouldn’t this be C ?
option A is not any “mode of operation” of hadoop.
0
0
Why not C?
0
0
Shouldn’t it be C ?
0
0
C – In a single machine as pseudo-distributed ‘mode’.
0
0
I think A is the correct answer because if we run all processes on just a single machine, it means all these daemons are running on just one instance of the operating system and does not simulate a cluster. We can install seperate VM for each of these daemons which forms a cluster.
0
0
I choose A
0
0