5.2 Designing Automation and Repeatability PROFESSIONAL-DATA-ENGINEER Practice Questions (Page 1)

Questions 1–5

1. 1foundation · easy

   In a Cloud Composer DAG, which configuration would you set on a task to automatically retry it if it fails due to a transient issue?

   • Acatchup = False
   • Bdepends_on_past = True
   • Cmax_active_runs = 1
   • Dretries = 3
   Reveal Solution Discussion Select an answer first
2. 2foundation · easy

   Which Airflow preset schedule_interval would you use to run a DAG every 30 minutes?

   • A@once
   • B@hourly
   • C@daily
   • D*/30 * * * *
   Reveal Solution Discussion Select an answer first
4. 3foundation · easy

   In a Cloud Composer DAG, which schedule_interval value would trigger the DAG to run every day at 2:00 AM UTC?

   • A2 0 * * *
   • B0 2 * * *
   • C0 2 * * 1
   • D0 0 2 * *
   Reveal Solution Discussion Select an answer first
5. 4application · medium

   A data engineer is writing a DAG that processes files from a Cloud Storage bucket. The DAG must be reusable for different buckets without editing the Python code. Which approach should be used?

   • AUse the bucket name as the DAG's dag_id.
   • BUse Airflow Variables to store the bucket name and retrieve it with Variable.get('bucket_name').
   • CCreate a new DAG file for each bucket by copying and pasting the code.
   • DHardcode the bucket name as a global variable in the DAG file.
   Reveal Solution Discussion Select an answer first
6. 5expert · hard

   A data engineer manages a Cloud Composer DAG that processes daily files. The DAG has a task that fails intermittently due to a downstream system being unavailable. The engineer wants to ensure the DAG does not waste resources retrying when the downstream system is known to be down for maintenance, but still retries for other transient errors. What is the most effective approach?

   • ASet retries=0 and rely on manual re-runs when the downstream system is available.
   • BSet the DAG's catchup=False to prevent missed runs from being executed.
   • CSet retries=3 and retry_delay=timedelta(minutes=10) on the task, and accept that retries will also occur during maintenance.
   • DUse a custom PythonOperator that checks a maintenance schedule and raises AirflowSkipException during maintenance, with retries enabled for other failures.
   Reveal Solution Discussion Select an answer first