Describe Apache Spark - Streaming Processing and Architecture DATA-ENGINEERING-OPTIMIZE Practice Questions (Page 2)

Questions 6–10

1. 6application · medium

   A logistics company uses Spark Streaming to process GPS data from delivery vehicles. They want to ensure that if a receiver fails, the data received before the failure is not lost. Which configuration is essential?

   • AEnable write-ahead logging to a reliable storage system.
   • BSet spark.streaming.receiver.maxRate to a lower value.
   • CUse multiple receivers for the same stream to increase parallelism.
   • DIncrease the batch interval to allow more time for data accumulation.
   Reveal Solution Discussion Select an answer first
2. 7application · medium

   A company is setting up a Spark Streaming application to process log data from multiple sources. They want to ensure that the application can recover from a driver failure without manual intervention. Which component is essential for this?

   • AA custom sink that buffers data.
   • BA high number of receivers.
   • CA large batch interval.
   • DCheckpointing to a reliable file system.
   Reveal Solution Discussion Select an answer first
4. 8foundation · easy

   What is the role of the batch interval in Spark Streaming?

   • AIt specifies the number of receivers to use for data ingestion
   • BIt defines the duration of each micro-batch of data
   • CIt determines how often the streaming application saves checkpoints
   • DIt controls the parallelism of the streaming computation
   Reveal Solution Discussion Select an answer first
5. 9application · medium

   A team is configuring a Spark Streaming application. They want to balance latency and throughput. Which parameter directly controls the frequency of micro-batches?

   • ANumber of receivers
   • BSink type
   • CCheckpoint directory
   • DBatch interval
   Reveal Solution Discussion Select an answer first
6. 10foundation · easy

   How does Spark Streaming achieve fault tolerance for DStreams?

   • ABy replicating all data to a distributed file system
   • BBy storing all data in a relational database
   • CBy using lineage information to recompute lost data
   • DBy using a single master node to manage all data
   Reveal Solution Discussion Select an answer first