Ingest Data into Unity Catalog DP-750 Practice Questions (Page 7)

Questions 31–35

1. 31application · medium

   A data engineer needs to ingest real-time telemetry from Azure Event Hubs into a Unity Catalog Delta table. The engineer wants to use a Databricks notebook and also wants to handle schema evolution (new fields appearing in the JSON). Which approach should the engineer use?

   • AUse Spark Structured Streaming with Event Hubs source and write to Delta with mergeSchema set to true.
   • BUse COPY INTO with Event Hubs source and schema inference.
   • CUse Auto Loader with Event Hubs source and schema inference.
   • DUse a batch notebook that reads from Event Hubs and writes with overwrite mode.
   Reveal Solution Discussion Select an answer first
2. 32application · medium

   A data engineer needs to ingest a large number of CSV files that are continuously dropped into an ADLS Gen2 directory. The files have varying schemas, and the engineer wants to use a declarative pipeline that automatically handles new files and schema inference. The engineer wants to use Lakeflow Spark Declarative Pipelines. Which approach should the engineer use?

   • AUse Spark Structured Streaming with a file source and append mode.
   • BUse COPY INTO with schema inference and evolution.
   • CUse a notebook with a batch read and overwrite mode.
   • DUse Auto Loader with schema inference and evolution, and write to a Delta table.
   Reveal Solution Discussion Select an answer first
4. 33application · medium

   A data engineer needs to ingest streaming data from a Kafka topic into a Unity Catalog Delta table. The engineer wants to use Spark Structured Streaming in a notebook and also wants to perform a stateful aggregation (e.g., count events per user over a window). Which approach should the engineer use?

   • AUse Lakeflow Connect to create a streaming pipeline from Kafka to Delta.
   • BUse Spark Structured Streaming with Kafka source, apply a windowed aggregation, and write the aggregated results to the Delta table.
   • CUse COPY INTO to load Kafka messages from a staging directory.
   • DUse Auto Loader to ingest Kafka messages as files and then process them with batch Spark.
   Reveal Solution Discussion Select an answer first
5. 34foundation · easy

   Which Databricks feature is often used within Lakeflow Spark Declarative Pipelines to incrementally ingest files from cloud storage?

   • ACOPY INTO
   • BAuto Loader
   • CDelta Live Tables
   • DDatabricks SQL
   Reveal Solution Discussion Select an answer first
6. 35foundation · easy

   When using CTAS to ingest data into Unity Catalog, what must be specified in the CREATE TABLE statement?

   • AThe cluster ID
   • BThe fully qualified table name (catalog.schema.table)
   • CThe file format of the source
   • DThe storage location
   Reveal Solution Discussion Select an answer first