PrepAway - Latest Free Exam Questions & Answers

Which scheduler would you deploy to ensure that your cluster allows short jobs to finish within a reasonable t

Which scheduler would you deploy to ensure that your cluster allows short jobs to finish within a
reasonable time without starving long-running jobs?

PrepAway - Latest Free Exam Questions & Answers

A.
FIFO Scheduler

B.
Fair Scheduler

C.
Capacity Scheduler

D.
Completely Fair Scheduler (CFS)

Explanation:
Fair scheduling is a method of assigning resources to jobs such that all jobs get, on

average, an equal share of resources over time. When there is a single job running, that job uses
the entire cluster. When other jobs are submitted, tasks slots that free up are assigned to the new
jobs, so that each job gets roughly the same amount of CPU time. Unlike the default Hadoop
scheduler, which forms a queue of jobs, this lets short jobs finish in reasonable time while not
starving long jobs. It is also a reasonable way to share a cluster between a number of users.
Finally, fair sharing can also work with job priorities – the priorities are used as weights to
determine the fraction of total compute time that each job should get.
Hadoop, Fair Scheduler Guide


Leave a Reply

Your email address will not be published. Required fields are marked *