Use Auto Loader with Schema Enforcement and Schema Evolution in Batch Modes (for Example, Directory Listing or File Notification) to Land Data into UnityCatalog–governed Tables. DATA-ENGINEER-ASSOCIATE Practice Questions (Page 1)

Questions 1–5

1. 1application · medium

   A data engineer is running an Auto Loader streaming query that ingests data from an S3 bucket into a Delta table. The query is stopped for maintenance and then restarted. The engineer wants to ensure that no files are processed twice and no files are missed. What is required for this to work?

   • AA trigger interval of 1 second.
   • BA unique query name for the streaming query.
   • CA schema location that stores the inferred schema.
   • DA checkpoint location that persists across restarts.
   Reveal Solution Discussion Select an answer first
2. 2foundation · easy

   What happens to records that do not conform to the enforced schema in Auto Loader?

   • AThey are stored in a separate table without any action
   • BThey are ignored and not processed at all
   • CThey are automatically corrected to fit the schema
   • DThey are handled according to the configured options, such as being dropped or causing an error
   Reveal Solution Discussion Select an answer first
4. 3foundation · easy

   Which of the following is a valid Auto Loader option for batch ingestion?

   • A`file.type`
   • B`cloudFiles.schemaLocation`
   • C`input.path`
   • D`spark.format`
   Reveal Solution Discussion Select an answer first
5. 4foundation · easy

   What does the `addNewColumns` schema evolution mode do in Auto Loader?

   • AIt requires manual intervention to add new columns
   • BIt fails the ingestion if any new column appears in the data
   • CIt automatically adds new columns to the target table schema when they appear in incoming data
   • DIt ignores new columns and only processes existing ones
   Reveal Solution Discussion Select an answer first
6. 5application · medium

   A data engineer is using Auto Loader to ingest JSON files from an S3 bucket. The files have a nested structure with a `customer` object containing `name` and `address` fields. The engineer wants Auto Loader to automatically detect the schema of the files. Which option should be used to enable schema inference?

   • ASet `cloudFiles.schemaLocation` to a path in the checkpoint directory.
   • BSet `cloudFiles.inferColumnTypes = 'true'`.
   • CDo nothing; schema inference is enabled by default in Auto Loader.
   • DSet `cloudFiles.schemaEvolutionMode = 'addNewColumns'`.
   Reveal Solution Discussion Select an answer first