Describe the Hadoop Ecosystem and Related Product Use Cases DATA-SCIENCE-FOUNDATIONS Practice Questions (Page 7)

Questions 31–35

1. 31foundation · easy

   A team needs to process a continuous stream of clickstream events and make them available to multiple applications in real time. Which Hadoop ecosystem component is most appropriate?

   • AFlume
   • BOozie
   • CSqoop
   • DKafka
   Reveal Solution Discussion Select an answer first
2. 32expert · hard

   A company wants to build a real-time recommendation engine that updates as users click items. They also need to process historical click data for model training. They have a Hadoop cluster and want to minimize latency for the real-time component while reusing the same data. Which architecture is most appropriate?

   • AUse Oozie to ingest clicks, Hive for real-time updates, and MapReduce for historical training
   • BUse Sqoop to ingest clicks, Pig for real-time updates, and HBase for historical training
   • CUse Flume to ingest clicks, MapReduce for real-time updates, and Hive for historical training
   • DUse Kafka to ingest clicks, Spark Streaming for real-time updates, and Spark batch for historical training
   Reveal Solution Discussion Select an answer first
4. 33foundation · easy

   Which Hadoop ecosystem component is best suited for machine learning algorithms that require multiple passes over the same dataset?

   • AHive
   • BSpark
   • CPig
   • DSqoop
   Reveal Solution Discussion Select an answer first
5. 34expert · hard

   A data science team runs an iterative machine learning algorithm that repeatedly scans the same dataset. They are considering MapReduce vs. Spark. The cluster is shared with other workloads, and they need to minimize disk I/O. Which approach should they choose and why?

   • ASpark, because it always uses less memory than MapReduce
   • BMapReduce, because it is the only model that supports iterative algorithms
   • CSpark, because it caches data in memory across iterations, reducing disk I/O
   • DMapReduce, because it caches intermediate data in memory by default
   Reveal Solution Discussion Select an answer first
6. 35foundation · easy

   Which Hadoop ecosystem component is most appropriate for a data engineer who wants to write a script to transform and clean large datasets before loading them into a data warehouse?

   • APig
   • BHBase
   • CHive
   • DSqoop
   Reveal Solution Discussion Select an answer first