Ingest Data into Unity Catalog DP-750 Practice Questions (Page 6)

Questions 26–30

1. 26application · medium

   A data engineer needs to ingest a continuous stream of events from a SaaS platform (e.g., a webhook feed) into a Unity Catalog Delta table. The engineer wants to use a managed service that handles the streaming connection and provides at-least-once delivery. Which approach should the engineer use?

   • AUse Azure Event Hubs as an intermediary and then use COPY INTO.
   • BUse Spark Structured Streaming in a notebook with a custom source.
   • CUse Lakeflow Connect Streaming Ingestion to create a streaming pipeline from the SaaS source to Unity Catalog.
   • DUse Auto Loader to ingest files from a staging directory.
   Reveal Solution Discussion Select an answer first
2. 27foundation · easy

   Which Azure service is a managed event streaming platform that can be used as a source for streaming ingestion into Unity Catalog?

   • AAzure SQL Database
   • BAzure Event Hubs
   • CAzure Data Factory
   • DAzure Blob Storage
   Reveal Solution Discussion Select an answer first
4. 28expert · hard

   A data engineer needs to ingest a CDC feed from a source database into a Unity Catalog table. The feed includes inserts, updates, and deletes, and the target table must reflect the exact state of the source. The engineer is using a notebook with Spark Structured Streaming. Which approach should they use to ensure the target table is accurate?

   • AUse `writeStream.format("delta").outputMode("append")` to write the CDC changes
   • BUse `foreachBatch` with a MERGE statement that handles inserts, updates, and deletes based on the CDC operation column
   • CUse `writeStream.format("delta").outputMode("update")` to write the CDC changes
   • DUse `writeStream.format("delta").outputMode("complete")` to write the CDC changes
   Reveal Solution Discussion Select an answer first
5. 29expert · hard

   A data engineer needs to ingest a CDC feed from a database into a Unity Catalog Delta table. The feed is delivered as JSON files in ADLS Gen2. The engineer wants to use Spark Structured Streaming in a notebook to process the files as they arrive. The target table must reflect the exact state of the source, including deletes. The engineer also needs to handle late-arriving data. Which approach should the engineer use?

   • AUse Auto Loader with a streaming read and foreachBatch to apply MERGE and DELETE operations to the Delta table.
   • BUse Spark Structured Streaming with a file source and append mode to write the CDC changes.
   • CUse Lakeflow Connect Streaming Ingestion to ingest the CDC files.
   • DUse COPY INTO with a batch read and then apply MERGE.
   Reveal Solution Discussion Select an answer first
6. 30application · medium

   A data engineer needs to ingest new JSON files that arrive incrementally in an ADLS Gen2 location into an existing Unity Catalog table. The files may contain duplicate records across runs, and the engineer wants to avoid reprocessing already-ingested files. The engineer prefers to use SQL. Which SQL statement should the engineer use?

   • AMERGE INTO ... USING json.`path`
   • BINSERT INTO ... SELECT * FROM json.`path`
   • CCOPY INTO ... FROM 'path' FILEFORMAT = JSON
   • DCREATE OR REPLACE TABLE ... AS SELECT * FROM json.`path`
   Reveal Solution Discussion Select an answer first