Spark DATA-SCIENCE-OPTIMIZE Practice Questions (Page 2)

Questions 6–10

1. 6foundation · easy

   Which of the following is an action in Spark?

   • Amap()
   • BflatMap()
   • Cfilter()
   • Dcount()
   Reveal Solution Discussion Select an answer first
2. 7expert · hard

   A streaming application is processing clickstream data and needs to compute the average session duration for users. The team is using Spark Structured Streaming with event-time windows. They notice that late-arriving data is being dropped, and they need to handle it. Which configuration should they use?

   • ASet the watermark to a value that accommodates expected late data
   • BDisable the watermark to allow all data to be processed
   • CUse a processing-time window instead of event-time
   • DIncrease the batch interval
   Reveal Solution Discussion Select an answer first
4. 8foundation · easy

   Which Spark SQL feature allows you to query structured data using standard SQL syntax?

   • ADataFrame.write()
   • BSparkSession.sql()
   • CRDD.map()
   • DSparkContext.textFile()
   Reveal Solution Discussion Select an answer first
5. 9application · medium

   A Spark application reads a large log file and needs to count the number of lines that contain the word 'ERROR'. The team wants to minimize the amount of data sent back to the driver. Which approach should they use?

   • AUse the count action on an RDD after applying a filter transformation
   • BUse the foreach action to increment a local counter on the driver
   • CUse the collect action to bring all lines to the driver and then count locally
   • DUse the take action to sample a few lines and estimate the count
   Reveal Solution Discussion Select an answer first
6. 10foundation · easy

   What is the primary purpose of Spark MLlib?

   • ATo handle real-time stream processing.
   • BTo provide a SQL interface for querying structured data.
   • CTo manage cluster resources and schedule tasks.
   • DTo provide scalable machine learning algorithms and utilities for large-scale data.
   Reveal Solution Discussion Select an answer first