Use the COPY INTO Command to Incrementally Load Files from Cloud Object Storage (ADLS/S3/GCS) into Unity‑Catalog–governed Tables. DATA-ENGINEER-ASSOCIATE Practice Questions (Page 2)

Questions 6–10

1. 6application · medium

   A data engineer is loading data from an S3 bucket that contains files with a naming convention like 'data_20240101.csv', 'data_20240102.csv', etc. The engineer wants to load only the files for a specific date using COPY INTO. What is the most efficient way to do this?

   • AUse a file pattern in the source path, e.g., COPY INTO ... FROM 's3://bucket/path/data_20240101.csv'
   • BLoad all files and use a WHERE clause to filter the data.
   • CUse a glob pattern in the source path, e.g., COPY INTO ... FROM 's3://bucket/path/data_202401*.csv'
   • DLoad all files and rely on the incremental load feature to skip already-loaded files.
   Reveal Solution Discussion Select an answer first
2. 7foundation · easy

   What happens when a COPY INTO command is run a second time against the same source path and target table, with no new files added?

   • AIt fails with an error because the table already contains the data.
   • BIt reloads all files because COPY INTO is not idempotent.
   • CIt loads no data and returns a success message.
   • DIt loads only files that have been modified since the last run.
   Reveal Solution Discussion Select an answer first
4. 8foundation · easy

   How can you use directory partitioning to optimize COPY INTO loads?

   • ABy using the PARTITIONED BY clause in COPY INTO.
   • BBy creating a separate COPY INTO command for each partition.
   • CBy setting a COPY_OPTION to automatically skip empty partitions.
   • DBy specifying a partition filter in the FROM clause to load only relevant subdirectories.
   Reveal Solution Discussion Select an answer first
5. 9foundation · easy

   What is the benefit of organizing source files into date-based directories (e.g., /data/2024/01/01/) when using COPY INTO?

   • AIt is required for COPY INTO to track processed files.
   • BIt allows COPY INTO to automatically partition the target table by date.
   • CIt makes the COPY INTO command run faster because files are smaller.
   • DIt enables loading only the files for a specific date using a glob pattern.
   Reveal Solution Discussion Select an answer first
6. 10foundation · easy

   Which of the following is the minimal set of clauses required for a COPY INTO command to load data from cloud object storage into a Delta table?

   • AINTO, FROM
   • BINTO, FROM, FILE_FORMAT
   • CINTO, FROM, FORMAT_OPTIONS
   • DINTO, FROM, COPY_OPTIONS
   Reveal Solution Discussion Select an answer first