Describe Apache Spark - Streaming Processing and Architecture DATA-ENGINEERING-OPTIMIZE Practice Questions (Page 6)

Questions 26–28

1. 26foundation · easy

   Which statement correctly contrasts Spark Streaming (DStreams) and Structured Streaming?

   • ADStreams provide exactly-once semantics, while Structured Streaming provides at-least-once
   • BDStreams use RDD-based API, while Structured Streaming uses DataFrame-based API
   • CDStreams are easier to use than Structured Streaming for SQL queries
   • DDStreams support event-time processing, while Structured Streaming does not
   Reveal Solution Discussion Select an answer first
2. 27application · medium

   A logistics company ingests GPS coordinates from delivery vehicles into a Kafka topic. They use Spark Streaming (DStreams) with a 5-second batch interval. Each vehicle sends a location update every 2 seconds. The team notices that some location updates are processed more than once after a node failure. Which configuration change would most directly address the duplicate processing while preserving the current micro-batch model?

   • AIncrease the batch interval from 5 seconds to 10 seconds to reduce the frequency of micro-batches.
   • BSwitch from Kafka direct stream to a receiver-based approach to improve reliability.
   • CSet spark.streaming.receiver.maxRate to a lower value to slow down data ingestion.
   • DEnable write-ahead logging (WAL) and set the streaming checkpoint directory to a fault-tolerant file system.
   Reveal Solution Discussion Select an answer first
3. 28foundation · easy

   What is a key architectural difference between Spark Streaming (DStreams) and Structured Streaming?

   • ADStreams are built on DataFrames, while Structured Streaming is built on RDDs
   • BDStreams use SQL for processing, while Structured Streaming uses RDDs
   • CDStreams provide exactly-once semantics, while Structured Streaming does not
   • DDStreams process data as micro-batches, while Structured Streaming can process data as a continuous stream
   Reveal Solution Discussion Select an answer first