Identify the Features of the Apache Spark Modules, Including Core, Spark SQL, DataFrames, Pandas API on Spark, Structured Streaming, and MLib. ASSOCIATE-DEVELOPER-APACHE-SPARK Practice Questions (Page 2)

Questions 6–10

1. 6foundation · easy

   Which of the following is a capability of MLlib?

   • AProviding a SQL interface for querying data
   • BProviding algorithms for classification, regression, and clustering
   • CProviding a streaming engine for real-time data
   • DProviding a low-level API for RDD manipulation
   Reveal Solution Discussion Select an answer first
2. 7expert · hard

   A team is building a real-time fraud detection system. They are using Structured Streaming to process transactions. They need to join the streaming transaction data with a static DataFrame containing known fraudulent account IDs. They also need to ensure that the system can recover from a failure without reprocessing old data. Which approach should they use?

   • AUse a stream-static join and configure checkpointing to enable fault-tolerance.
   • BUse MLlib to build a model that can detect fraud in real-time.
   • CUse the Pandas API on Spark to perform the join in a batch manner.
   • DUse a stream-stream join and rely on the watermark to handle late data.
   Reveal Solution Discussion Select an answer first
4. 8foundation · easy

   Which Spark module allows you to run SQL queries directly on data files and also provides the DataFrame API?

   • ASpark SQL
   • BMLlib
   • CSpark Core
   • DStructured Streaming
   Reveal Solution Discussion Select an answer first
5. 9foundation · easy

   What is the purpose of the Pandas API on Spark?

   • ATo replace pandas with a new, more efficient library
   • BTo provide a distributed implementation of the pandas API for running pandas code on Spark
   • CTo convert Spark DataFrames to local pandas DataFrames automatically
   • DTo provide a SQL interface for pandas DataFrames
   Reveal Solution Discussion Select an answer first
6. 10foundation · easy

   What is a key characteristic of Structured Streaming?

   • AIt provides exactly-once processing guarantees and is built on the Spark SQL engine
   • BIt is a library for machine learning on streaming data
   • CIt is a batch processing engine that cannot handle real-time data
   • DIt is a low-level API for managing RDDs
   Reveal Solution Discussion Select an answer first