Describe Adaptive Query Execution (AQE) and Its Benefits. ASSOCIATE-DEVELOPER-APACHE-SPARK Practice Questions (Page 5)

Questions 21–25

1. 21application · medium

   A company has a Spark job that joins two large tables. The join key is not skewed, but the size of one table varies significantly between runs. The team is currently manually tuning the join strategy by setting spark.sql.autoBroadcastJoinThreshold. They want to reduce the operational overhead of this manual tuning. What is the most effective way to achieve this?

   • ASet spark.sql.adaptive.coalescePartitions.enabled=true
   • BEnable AQE and let it dynamically select the join strategy
   • CIncrease the number of shuffle partitions to improve parallelism
   • DUse a broadcast hint on the smaller table
   Reveal Solution Discussion Select an answer first
2. 22foundation · easy

   How does dynamic skew join optimization handle data skew?

   • ABy splitting skewed partitions into smaller ones and repartitioning them
   • BBy converting the join to a broadcast join
   • CBy increasing the number of shuffle partitions globally
   • DBy dropping skewed partitions from the query
   Reveal Solution Discussion Select an answer first
4. 23foundation · easy

   Which configuration property controls the minimum size for a partition to be considered skewed in AQE?

   • Aspark.sql.adaptive.skewJoin.skewedPartitionFactor
   • Bspark.sql.adaptive.coalescePartitions.enabled
   • Cspark.sql.adaptive.advisoryPartitionSizeInBytes
   • Dspark.sql.adaptive.nonEmptyPartitionRatioForBroadcastJoin
   Reveal Solution Discussion Select an answer first
5. 24foundation · easy

   Which of the following is a feature of Adaptive Query Execution?

   • ADynamic partition pruning
   • BAutomatic schema inference
   • CAutomatic query caching
   • DDynamic resource scaling
   Reveal Solution Discussion Select an answer first
6. 25foundation · easy

   What does dynamic join strategy selection in AQE decide at runtime?

   • AWhich columns to join on
   • BWhich join algorithm to use (e.g., broadcast, sort-merge)
   • CWhether to cache the join result
   • DHow many shuffle partitions to create
   Reveal Solution Discussion Select an answer first