Describe Apache Spark and Its Architecture DATA-ENGINEERING-OPTIMIZE Practice Questions (Page 4)

Questions 16–18

1. 16foundation · easy

   How does Spark Streaming integrate with the core Spark engine?

   • AIt runs as a separate engine that communicates with Spark via a network protocol
   • BIt uses the same RDD and DataFrame APIs to process micro-batches as batch jobs
   • CIt requires a dedicated cluster manager to handle streaming workloads
   • DIt converts streaming data into files before processing
   Reveal Solution Discussion Select an answer first
2. 17application · medium

   An organization runs Spark on a Hadoop cluster that already uses YARN for resource management. They want to submit Spark jobs that can share cluster resources with other YARN applications and have YARN handle scheduling. Which cluster manager should they use?

   • AKubernetes
   • BYARN
   • CMesos
   • DStandalone
   Reveal Solution Discussion Select an answer first
3. 18application · medium

   A team is writing a Spark job to process structured log files. They need to perform complex SQL-like aggregations and benefit from automatic query optimization. Which API should they use?

   • ASpark Streaming
   • BPairRDD functions
   • CDataFrames
   • DRDDs
   Reveal Solution Discussion Select an answer first