Develop a Batch Processing Solution DP-203 Practice Questions (Page 7)

Questions 31–35

1. 31foundation · easy

   Which practice is commonly used to validate that a data pipeline produces the expected output data quality and schema?

   • AIncreasing the batch size
   • BEnabling autoscaling
   • CScaling up the compute resources
   • DWriting unit tests and data quality checks
   Reveal Solution Discussion Select an answer first
2. 32application · medium

   A company stores historical sales data in Azure Data Lake Storage Gen2. The data is partitioned by date, and the company needs to retain the data for 5 years for reporting purposes. After 5 years, the data should be automatically deleted to reduce storage costs. The data engineering team needs to implement a solution that requires minimal manual intervention. What should the team do?

   • AWrite a scheduled Azure Data Factory pipeline that deletes partitions older than 5 years using a 'Delete' activity.
   • BUse an Azure Databricks job to run a script that deletes old data from the storage account on a schedule.
   • CCreate a lifecycle management policy in Azure Data Lake Storage Gen2 that deletes blobs older than 5 years.
   • DManually delete the old data at the end of each year using Azure Storage Explorer.
   Reveal Solution Discussion Select an answer first
4. 33application · medium

   A retail company stores its daily sales transactions in a Delta Lake table in Azure Data Lake Storage Gen2. The data engineering team needs to update the table with new records and modify existing records based on a nightly feed from the ERP system. They also need the ability to revert the table to the state it was in before the nightly update if a data quality issue is discovered the next morning. What should the team implement?

   • APerform separate INSERT and UPDATE operations for new and existing records, and maintain a full backup of the table in a separate storage account for rollback.
   • BUse a MERGE operation to upsert the incoming data, and rely on the Delta Lake transaction log to time-travel to the previous version if a rollback is needed.
   • COverwrite the entire table with the incoming data using a DELETE and INSERT approach, and use the Delta Lake vacuum command to clean up old versions for rollback.
   • DUse a COPY INTO command to append new records and a separate UPDATE statement for changes, then rely on Azure Data Lake Storage Gen2 snapshots for reversion.
   Reveal Solution Discussion Select an answer first
5. 34foundation · easy

   In Azure Data Factory, which component is a logical grouping of activities that perform a unit of work in a data pipeline?

   • AIntegration runtime
   • BDataset
   • CPipeline
   • DTrigger
   Reveal Solution Discussion Select an answer first
6. 35foundation · easy

   Which Azure service is commonly used to create and schedule batch data pipelines that move data from on-premises sources to the cloud?

   • AAzure Databricks
   • BAzure Logic Apps
   • CAzure Synapse Analytics
   • DAzure Data Factory
   Reveal Solution Discussion Select an answer first