Combine DataFrames with Operations Such as Inner Join, Left Join, Broadcast Join, Multiple Keys, Cross Join, Union, and Union All. DATA-ENGINEER-ASSOCIATE Practice Questions (Page 3)

Questions 11–13

1. 11application · medium

   A data engineer is joining a large `web_logs` DataFrame (hundreds of millions of rows) with a small `ip_lookup` DataFrame (a few thousand rows) on `ip_address`. The join is slow due to shuffling. The engineer wants to optimize the join. Which approach is the most effective?

   • ARepartition the web_logs DataFrame by ip_address
   • BUse a sort-merge join by sorting both DataFrames by ip_address
   • CIncrease the number of shuffle partitions
   • DUse a broadcast hint on the ip_lookup DataFrame
   Reveal Solution Discussion Select an answer first
2. 12foundation · easy

   You have two DataFrames with identical schemas. You want to combine them into a single DataFrame that contains no duplicate rows. Which operation should you use?

   • AUnion all
   • BCross join
   • CInner join
   • DUnion
   Reveal Solution Discussion Select an answer first
3. 13foundation · easy

   Which DataFrame operation returns only the rows that have matching keys in both input DataFrames?

   • ALeft join
   • BUnion
   • CCross join
   • DInner join
   Reveal Solution Discussion Select an answer first