For each YARN Job, the Hadoop framework generates task log files. Where are Hadoop’s files
stored?
A.
In HDFS, In the directory of the user who generates the job
B.
On the local disk of the slave node running the task
C.
Cached In the YARN container running the task, then copied into HDFS on fob completion
D.
Cached by the NodeManager managing the job containers, then written to a log directory on
the NameNode
Explanation:
http://hortonworks.com/blog/simplifying-user-logs-management-and-access-in-yarn/
C would be my guess on this one.
$ hdfs dfs -ls -R /
/tmp/hadoop-yarn/staging/history/done/2016/01/24/000000/job_1453658600005_0002-1453658690916-hadoop-grep%2Dsearch-1453658743857-17-1-SUCCEEDED-default-1453658696383.jhist
0
0
It’s B as far as I know
“yarn.nodemanager.log-dirs: Determines where the container-logs are stored on the node when the containers are running. Default is ${yarn.log.dir}/userlogs.”
0
0
B…
on the local disk
0
0
I dont understand this question. Is said generate log file. So it is asking where the log files stored or the Hadoop File?
If log file i think A is the answer.
If Hadoop File then B should be correct
0
0
Question is bit confusing where in first half it talks about YARN log files, but actual question is in second half – “Where are Hadoop’s files stored?”
I believe answer is A
0
0
Its a tricky question where they are talking about logs in first half and asking for hadoop file storage location hence here the answer is A.
Below is similar question where its talks about log files –
For each YARN job, the Hadoop framework generates task log file. Where are Hadoop task log
files stored?
A.
Cached by the NodeManager managing the job containers, then written to a log directory on
the NameNode
B.
Cached in the YARN container running the task, then copied into HDFS on job completion
C.
In HDFS, in the directory of the user who generates the job
D.
On the local disk of the slave mode running the task
Here answer id D
0
0