A streaming pipeline ingests user activity data. The `user_id` is PII and must be masked in real-time. However, the pipeline also needs to support a requirement to unmask the data for a specific compliance investigation. Which approach should they use?

Use a redaction function and rely on the transaction log for recovery.

Use a reversible masking technique (e.g., format-preserving encryption) and store the encryption key securely.

Use a one-way hash function and store the original data in a separate table.

Use a tokenization service and store the token mapping in the same table.

A company needs to purge customer records that are older than 5 years from a Delta table. The purge must be performed in a way that allows for recovery in case of accidental deletion. Which approach should they use?

Use `DROP TABLE` to remove the entire table.

Use `TRUNCATE TABLE` to remove all records.

Use `DELETE FROM` to remove the records from the Delta table.

Use `VACUUM` to physically delete the old files.

After a data purging job runs, the compliance team needs to verify that the correct records were deleted and that an audit trail exists for regulatory evidence. The purge job deletes records from a Delta table based on a retention policy. Which approach should they use to verify and audit the purge?

Query the Delta table's transaction log to confirm the delete operation and the number of affected rows, and store the job metadata in a separate audit table.

Use `DESCRIBE HISTORY` on the table to view the delete operation, but do not store any additional metadata.

Manually check a sample of the remaining records to ensure they are within the retention period.

Run a `SELECT COUNT(*)` query on the table before and after the purge and compare the counts.

A company ingests customer feedback data from multiple sources. The compliance team needs to identify PII fields, but the data is highly variable and includes free-text comments. The detection must be automated and run on a schedule. Which approach should they use?

Use a machine learning model that is trained once and deployed to classify columns.

Apply masking to all columns in the table without detection.

Manually review the data each time a new source is added.

Run a scheduled data profiling job that samples the data and applies regex patterns and keyword matching to flag potential PII columns.

A streaming pipeline ingests clickstream data from a website. The `user_id` field is considered PII and must be masked in real-time before the data is written to a Delta table for downstream analysis. The pipeline uses Structured Streaming. Which approach should they use?

Apply a masking function (e.g., hash) to the `user_id` column in the streaming DataFrame before writing to the sink.

Mask the `user_id` column in the downstream analytics queries only.

Use a UDF to mask the `user_id` column in the streaming DataFrame, but only for the first micro-batch.

Write the raw data to the Delta table first, then run a separate batch job to mask the `user_id` column.

DatabricksCertified Data Engineer Professional

Domain 7Objective 2

Ensuring Compliance DATA-ENGINEER-PROFESSIONAL Practice Questions (Page 4)

Part of the Ensuring Data Security and Compliance domain, which accounts for 10% of the DATA-ENGINEER-PROFESSIONAL exam. Databricks does not publish an official question count, but from its 120-minute exam (~50–80 total, ~5–8 in this domain), expect 3–4 from this objective — we provide 28 practice questions to prepare you well beyond it. (estimate)

28questions here

6free pages

8concepts

10%of the exam

Questions 16–20

16expert · hard
A streaming pipeline ingests user activity data. The `user_id` is PII and must be masked in real-time. However, the pipeline also needs to support a requirement to unmask the data for a specific compliance investigation. Which approach should they use?
Select an answer first
17application · medium
A company needs to purge customer records that are older than 5 years from a Delta table. The purge must be performed in a way that allows for recovery in case of accidental deletion. Which approach should they use?
Select an answer first
18expert · hard
After a data purging job runs, the compliance team needs to verify that the correct records were deleted and that an audit trail exists for regulatory evidence. The purge job deletes records from a Delta table based on a retention policy. Which approach should they use to verify and audit the purge?
Select an answer first
19expert · hard
A company ingests customer feedback data from multiple sources. The compliance team needs to identify PII fields, but the data is highly variable and includes free-text comments. The detection must be automated and run on a schedule. Which approach should they use?
Select an answer first
20application · medium
A streaming pipeline ingests clickstream data from a website. The `user_id` field is considered PII and must be masked in real-time before the data is written to a Delta table for downstream analysis. The pipeline uses Structured Streaming. Which approach should they use?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to DATA-ENGINEER-PROFESSIONAL

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by Databricks. “DATA-ENGINEER-PROFESSIONAL” is a trademark of its owner, used for identification only.