3.3 Using a Data Lake PROFESSIONAL-DATA-ENGINEER Practice Questions (Page 2)

Questions 6–10

1. 6foundation · easy

   A data engineer wants to limit the cost of a data lake by automatically deleting files that are older than 30 days. Which Cloud Storage feature should they use?

   • ACloud Billing budget alerts
   • BCloud Storage transfer service
   • CBucket retention policy
   • DObject lifecycle management
   Reveal Solution Discussion Select an answer first
2. 7foundation · easy

   A data engineer needs to run a one-time transformation on a large dataset stored in a Cloud Storage data lake. The transformation logic is complex and requires custom code. Which Google Cloud service is most appropriate for this task?

   • ADataproc
   • BCloud Functions
   • CCloud SQL
   • DCloud Storage
   Reveal Solution Discussion Select an answer first
4. 8expert · medium

   A company has a data lake on Cloud Storage with a mix of CSV and Avro files. They need to process the data and load it into BigQuery for analysis. The data is updated daily, and the company wants to automate the process. The company also wants to monitor the pipeline for failures. What should the data engineer do?

   • AUse Cloud Composer to orchestrate a Dataflow pipeline that reads from Cloud Storage and loads into BigQuery, and set up Cloud Monitoring alerts.
   • BUse Cloud Scheduler to trigger a Cloud Function that loads data into BigQuery, and use Cloud Logging for monitoring.
   • CUse BigQuery scheduled queries to load data from Cloud Storage, and use Cloud Monitoring for alerts.
   • DUse Dataproc to run a Spark job that loads data into BigQuery, and use Cloud Monitoring for alerts.
   Reveal Solution Discussion Select an answer first
5. 9application · medium

   A data engineering team manages a data lake on Cloud Storage with multiple buckets for different data domains. They want to monitor the overall health of the data lake, including storage usage, object counts, and access errors. They also want to be alerted if there is a sudden spike in access errors. What should the data engineer do?

   • AUse Cloud Logging to view logs and set up log-based alerts for access errors.
   • BUse Cloud Audit Logs to monitor access and set up alerts on audit log entries.
   • CUse Cloud Billing reports to monitor storage costs and set up budget alerts.
   • DUse Cloud Monitoring to create dashboards for storage usage and object counts, and set up alerts on the error metrics.
   Reveal Solution Discussion Select an answer first
6. 10expert · medium

   A large e-commerce company has a data lake on Cloud Storage with terabytes of Parquet data. They need to run complex analytical queries that join multiple tables and aggregate data. The queries are run by a team of data scientists, and the results are used for business decisions. The company wants to minimize query latency and cost. What should the data engineer do?

   • ALoad the Parquet data into BigQuery as native tables and use partitioning and clustering.
   • BUse BigQuery to query the data directly from Cloud Storage using external tables.
   • CUse Dataproc to run Spark SQL on the data and store results in a separate bucket.
   • DUse Cloud Dataflow to pre-aggregate the data and store the results in BigQuery.
   Reveal Solution Discussion Select an answer first