Your cluster is running MapReduce version 2 (MRv2) on YARN. Your ResourceManager is
configured to use the FairScheduler. Now you want to configure your scheduler such that a new
user on the cluster can submit jobs into their own queue application submission. Which
configuration should you set?
A.
You can specify new queue name when user submits a job and new queue can be created
dynamically if the property yarn.scheduler.fair.allow-undecleared-pools = true
B.
Yarn.scheduler.fair.user.fair-as-default-queue = false and yarn.scheduler.fair.allowundecleared-pools = true
C.
You can specify new queue name when user submits a job and new queue can be created
dynamically if yarn .schedule.fair.user-as-default-queue = false
D.
You can specify new queue name per application in allocations.xml file and have new jobs
automatically assigned to the application queue
there is nothing like “Yarn.scheduler.fair.user.fair-as-default-queue “. A is correct.
0
0
do your homework.
https://hadoop.apache.org/docs/stable2/hadoop-yarn/hadoop-yarn-site/FairScheduler.html
0
0
Answer is B
0
0
https://hadoop.apache.org/docs/r2.4.1/hadoop-yarn/hadoop-yarn-site/FairScheduler.html
yarn.scheduler.fair.allow-undeclared-pools
If this is true, new queues can be created at application submission time, whether because they are specified as the application’s queue by the submitter or because they are placed there by the user-as-default-queue property. If this is false, any time an app would be placed in a queue that is not specified in the allocations file, it is placed in the “default” queue instead. Defaults to true. If a queue placement policy is given in the allocations file, this property is ignored.
so A is correct
0
0
D is also correct:
https://blogs.oracle.com/datawarehousing/entry/fairscheduling_conventions_in_hadoop
” I’ve explicitly set my username to have upper and lower bounds on the maps and reduces, and allotted myself double the number of running jobs. Now, if I run hive or pig jobs from either the console or via the Hue web interface, I’ll be treated “fairly” by the JobTracker. There’s a lot more tweaking that can be done to the allocations file, so it’s best to dig down into the description and start trying out allocations that might fit your workload.”
0
0
From Document: Definitive Guide – Version 4, Page 93.
I said that:
It’s also possible to set this policy without using an allocation file, by setting
yarn.scheduler.fair.user-as-default-queue=false so that applications will be placed in the default queue rather than a per-user queue.
In addition,
yarn.scheduler.fair.allow-undeclared-pools=false so that users can’t create queues on the fly.
###
so that, if we want “a new user on the cluster can submit jobs into their own queue application submission” as asked by question, I think we need set-up as following:
yarn.scheduler.fair.user-as-default-queue=true
yarn.scheduler.fair.allow-undeclared-pools=true
from Multi-choice questions above, my view: only A is most suitable.
0
0
Answer : A
yarn.scheduler.fair.allowundeclared-pools
(yarn-site.xml)
When true, new pools can be created at
application submission time or by the
user-as-default-queue property. When
false, submitting to a pool that is not
specified in the fair-scheduler.xml
file causes the application to be placed in
the “default” pool. Default: true. Ignored if
a pool placement policy is defined in the
fair-scheduler.xml file.
————————————————————–
yarn.scheduler.fair.useras-default-queue
(yarn-site.xml)
Send jobs to pools based on users’
names instead of to the default pool,
root.default. Default: true.
0
0
Allow Undeclared Pools
yarn.scheduler.fair.allow-undeclared-pools True
============
When set to true, pools specified in applications but not explicitly configured, are created at runtime with default settings. When set to false, applications specifying pools not explicitly configured run in a pool named default. This setting applies when an application explicitly specifies a pool and when the application runs in a pool named with the username associated with the application.
Above line is from Cloudera Manager Dynamic Pool tab.
So Answer is “A”
Niraj
0
0
A is the best answer.
0
0
I agree with the answer. A
0
0