5.2 Designing Automation and Repeatability PROFESSIONAL-DATA-ENGINEER Practice Questions (Page 2)

Questions 6–10

1. 6foundation · easy

   In Cloud Composer, what is the primary benefit of parameterizing tasks in a DAG, such as using Airflow Variables or templated parameters?

   • AIt automatically retries failed tasks
   • BIt reduces the number of DAG files needed for similar pipelines
   • CIt increases the speed of task execution
   • DIt ensures tasks run in parallel
   Reveal Solution Discussion Select an answer first
2. 7expert · hard

   A data engineer is designing a DAG where a task must run only if a previous task was skipped, not if it succeeded. The engineer wants to use the trigger_rule to achieve this. Which trigger_rule should be set on the downstream task?

   • A'all_success'
   • B'one_success'
   • C'all_skipped'
   • D'all_done'
   Reveal Solution Discussion Select an answer first
4. 8foundation · easy

   In a Cloud Composer DAG file written in Python, which Airflow construct is used to define a single unit of work, such as running a Bash command or a BigQuery query?

   • AHook
   • BSensor
   • COperator
   • DVariable
   Reveal Solution Discussion Select an answer first
5. 9foundation · easy

   Which property of a DAG is essential for ensuring that a workflow can be executed to completion?

   • AIt is a graph, so tasks can be connected in any pattern, including loops
   • BIt is directed, so data flows only from tasks that have completed to tasks that are waiting
   • CIt is directed, so each task can have multiple upstream and downstream tasks
   • DIt is acyclic, so there are no cycles that would cause tasks to depend on themselves indefinitely
   Reveal Solution Discussion Select an answer first
6. 10expert · hard

   A data engineer is configuring a DAG that must run at 2:00 AM UTC every day. The DAG processes data from the previous day. The engineer notices that the DAG run for a given date is scheduled at 2:00 AM of the following day. What is the reason for this behavior?

   • AAirflow schedules a DAG run at the end of the interval, so a daily DAG with schedule_interval='0 2 * * *' runs at 2:00 AM the next day.
   • BThe DAG's catchup is enabled, causing the scheduler to run the DAG for the previous day at the current time.
   • CThe DAG's timezone is set to UTC+1, shifting the schedule by one hour.
   • DThe DAG's start_date is set incorrectly, causing the schedule to shift by one day.
   Reveal Solution Discussion Select an answer first