Task 3.3: Maintain and Monitor Data Pipelines DEA-C01 Practice Questions (Page 1)

Questions 1–5

1. 1foundation · easy

   A data engineer needs to create a logical container in Amazon CloudWatch Logs to store logs from a data pipeline application. Which resource should be created?

   • AMetric filter
   • BLog group
   • CLog event
   • DLog stream
   Reveal Solution Discussion Select an answer first
2. 2application · medium

   An AWS Glue job that runs every hour has started failing with the error 'S3Exception: Access Denied'. The job uses an IAM role that has permissions to read from the source S3 bucket and write to the destination bucket. What is the most likely cause of this failure?

   • AThe IAM role's policy does not include permission to list the objects in the source bucket.
   • BThe destination S3 bucket is in a different AWS Region than the Glue job.
   • CThe Glue job's script has a syntax error that prevents it from reading the source data.
   • DThe CloudWatch Logs group for the Glue job has reached its retention limit.
   Reveal Solution Discussion Select an answer first
4. 3application · medium

   A data engineering team runs a nightly AWS Glue ETL job that processes streaming data from Kinesis Data Streams. Recently, the job has been taking longer to complete, and the team suspects a bottleneck. Which combination of monitoring steps should the team use to identify the root cause?

   • AEnable detailed CloudTrail logging for the Glue job and analyze the API call history to identify the exact step that is slow.
   • BSet up an SNS notification to alert the team when the job duration exceeds a threshold, then wait for the alert to identify the issue.
   • CUse Athena to query the job's CloudTrail logs for any failed API calls that might indicate a resource limit being reached.
   • DReview the job's CloudWatch metrics for DPU usage, memory, and execution time, and then examine the job's Spark UI logs in CloudWatch Logs.
   Reveal Solution Discussion Select an answer first
5. 4application · medium

   A healthcare company is required to provide auditors with a record of all API calls made to their AWS data pipeline resources, including who made the call, when, and from which IP address. The company has enabled CloudTrail. What additional step is necessary to ensure the audit trail is complete and secure?

   • ACreate an IAM role that allows auditors to access the CloudTrail logs directly from the CloudTrail console.
   • BEnable CloudTrail log file validation and store the logs in an S3 bucket with a bucket policy that prevents deletion.
   • CEnable S3 server access logging on the CloudTrail S3 bucket to capture all access to the audit logs.
   • DConfigure CloudTrail to send logs to CloudWatch Logs and create an SNS topic for any log entries that contain 'DeleteBucket'.
   Reveal Solution Discussion Select an answer first
6. 5expert · hard

   A data engineering team runs a critical AWS Glue job that processes financial data. The job has been failing sporadically with 'OutOfMemoryError' in the Spark executors. The team has already increased the executor memory, but the issue persists. What should they do next to troubleshoot the issue?

   • ASwitch the Glue job to use a different Spark version.
   • BIncrease the number of DPUs for the Glue job to provide more memory.
   • CAnalyze the Spark UI logs in CloudWatch Logs to identify the stage that is causing the memory issue.
   • DUse CloudTrail to check if any API calls are causing the job to fail.
   Reveal Solution Discussion Select an answer first