Debugging and Troubleshooting DATA-ENGINEER-PROFESSIONAL Practice Questions (Page 4)

Questions 16–20

1. 16foundation · easy

   To investigate why a specific job run failed, which system table provides the most detailed error and failure information for that run?

   • Asystem.lakeflow.pipeline_runs
   • Bsystem.jobs.job_runs
   • Csystem.compute.node_types
   • Dsystem.jobs.job_run_errors
   Reveal Solution Discussion Select an answer first
2. 17application · medium

   A Lakeflow Spark Declarative Pipeline failed during a table update. The engineer needs to determine which task in the pipeline failed and why. Which two resources should the engineer consult?

   • AThe driver log and the executor log for the cluster.
   • BThe pipeline's event logs and the Spark UI for the failed run.
   • CThe notebook's cell output and the pipeline's configuration file.
   • DThe cluster logs and the job run history in `system.jobs.runs`.
   Reveal Solution Discussion Select an answer first
4. 18foundation · easy

   In the Databricks SQL query profile, which section shows the physical operators and their execution metrics, such as number of output rows and duration, for each step of the query?

   • AQuery text
   • BCluster metrics
   • CQuery history
   • DQuery plan
   Reveal Solution Discussion Select an answer first
5. 19application · medium

   A scheduled job failed last night. The engineer needs to understand why the job failed and whether a repair is appropriate. Which system table query would provide the most useful information for this analysis?

   • A`SELECT * FROM system.lakeflow.pipeline_runs WHERE pipeline_id = 456`
   • B`SELECT * FROM system.jobs.runs WHERE job_id = 123 ORDER BY start_time DESC LIMIT 1`
   • C`SELECT * FROM system.access.audit WHERE action = 'runJob'`
   • D`SELECT * FROM system.compute.cluster_events WHERE cluster_id = 'abc'`
   Reveal Solution Discussion Select an answer first
6. 20expert · hard

   A job fails with a `Permission denied` error when writing to a cloud storage path. The job runs successfully when the engineer runs it manually with the same cluster, but fails when scheduled. The engineer checks the `system.jobs.runs` table and sees the error message. Which is the most likely cause?

   • AThe job's code has a bug that only manifests when run at a specific time.
   • BThe job's parameters are different in the scheduled run, pointing to a different path.
   • CThe cluster is not configured with the correct cloud storage credentials.
   • DThe scheduled job uses a different service principal or access token that lacks write permissions to the path.
   Reveal Solution Discussion Select an answer first