2.3 Deploying and Operationalizing the Pipelines PROFESSIONAL-DATA-ENGINEER Practice Questions (Page 1)

Questions 1–5

1. 1application · medium

   Your team needs to orchestrate a data pipeline that runs a series of HTTP API calls to external services, with each call depending on the previous response. The pipeline is event-driven and must scale to zero when idle. You want minimal infrastructure management and no need to manage a dedicated scheduler. Which service should you use?

   • ACloud Composer
   • BCloud Functions
   • CCloud Scheduler
   • DCloud Workflows
   Reveal Solution Discussion Select an answer first
2. 2foundation · easy

   What is the purpose of Infrastructure as Code (IaC) in the context of pipeline deployment automation?

   • ATo define and manage infrastructure resources using declarative configuration files
   • BTo run pipeline code on a schedule
   • CTo manually configure infrastructure through the Cloud Console
   • DTo store pipeline code in a version control system
   Reveal Solution Discussion Select an answer first
4. 3application · medium

   Your team needs to orchestrate a complex data pipeline that involves multiple steps: extracting data from various sources, transforming it with Apache Spark, loading it into BigQuery, and then sending notifications. The pipeline has complex dependencies, retries, and backfills. You need a managed service that supports these features and allows you to define the workflow as code. Which service should you choose?

   • ACloud Dataflow
   • BCloud Workflows
   • CCloud Scheduler
   • DCloud Composer
   Reveal Solution Discussion Select an answer first
5. 4foundation · easy

   Which Google Cloud service is designed to orchestrate HTTP-based and serverless workflows using a YAML-based definition?

   • AWorkflows
   • BCloud Tasks
   • CCloud Scheduler
   • DCloud Composer
   Reveal Solution Discussion Select an answer first
6. 5expert · hard

   Your team is building a data pipeline that requires both complex orchestration with retries and backfills, and also needs to trigger a serverless workflow that calls external HTTP APIs. You want to minimize operational overhead and cost. You decide to use Cloud Composer for the main pipeline and Cloud Workflows for the HTTP-based steps. How should you integrate these services?

   • AUse Cloud Workflows to orchestrate the entire pipeline, including the complex retries and backfills
   • BUse Cloud Scheduler to trigger both Cloud Composer and Cloud Workflows independently
   • CUse Cloud Composer to call the HTTP APIs directly, avoiding the need for Cloud Workflows
   • DUse a Cloud Composer task that calls the Cloud Workflows API to trigger the workflow, and then poll for its completion
   Reveal Solution Discussion Select an answer first