Create and Write Streaming DataFrames and Streaming Datasets, Including the Basic Output Modes and Output Sinks. ASSOCIATE-DEVELOPER-APACHE-SPARK Practice Questions (Page 1)

Questions 1–5

1. 1application · medium

   A streaming query reads IoT sensor readings from Kafka. Each record contains a device_id, a reading_value, and an event_timestamp. The team needs a continuously updated dashboard showing the latest reading per device. They write the stream to a memory sink for the dashboard to query. Which output mode should they configure?

   • Aoverwrite
   • Bupdate
   • Ccomplete
   • Dappend
   Reveal Solution Discussion Select an answer first
2. 2foundation · medium

   A developer needs to create a streaming DataFrame that reads JSON data from a directory in cloud object storage. Which code snippet correctly creates the streaming DataFrame?

   • Aspark.stream.read.format("json").load("s3://bucket/path")
   • Bspark.read.format("json").stream("s3://bucket/path")
   • Cspark.readStream.format("json").load("s3://bucket/path")
   • Dspark.readStream.json("s3://bucket/path")
   Reveal Solution Discussion Select an answer first
4. 3expert · hard

   A team is building a streaming pipeline that reads from Kafka, aggregates events by a 5-minute tumbling window, and writes results to both a Delta table (for historical analysis) and a memory sink (for a live dashboard). They need exactly-once semantics for the Delta table and the dashboard must always show the full aggregation. The query must also handle late data. Which approach satisfies all requirements?

   • AUse append mode without a watermark and write to both sinks in a single query
   • BUse append mode with a watermark, write to the Delta sink, and use a separate query for the memory sink with complete mode
   • CUse complete mode with a watermark and write to both sinks in a single query
   • DUse update mode with a watermark and write to both sinks in a single query
   Reveal Solution Discussion Select an answer first
5. 4foundation · easy

   Which sink is used to write streaming output to an in-memory table that can be queried interactively?

   • AforeachBatch sink
   • BKafka sink
   • CFile sink
   • DMemory sink
   Reveal Solution Discussion Select an answer first
6. 5foundation · easy

   Which option is used with writeStream to specify the processing interval for micro-batch execution?

   • A.outputMode("append")
   • B.option("interval", "10 seconds")
   • C.trigger(ProcessingTime("10 seconds"))
   • D.option("batchInterval", "10 seconds")
   Reveal Solution Discussion Select an answer first