Task 3.3: Maintain and Monitor Data Pipelines DEA-C01 Practice Questions (Page 4)

Questions 16–20

1. 16foundation · easy

   An AWS Glue job fails with an out-of-memory error. Which AWS Glue setting should a data engineer adjust to resolve this issue?

   • AEnable job bookmarking
   • BIncrease the number of DPUs (Data Processing Units)
   • CIncrease the job timeout
   • DChange the job's IAM role
   Reveal Solution Discussion Select an answer first
2. 17expert · hard

   A data engineering team runs an Amazon EMR cluster that processes a large dataset every night. The cluster uses spot instances for task nodes. Recently, the job has been failing intermittently with 'Container killed by YARN for exceeding memory limits'. The team needs to resolve this issue without significantly increasing costs. What should they do?

   • AReduce the number of partitions in the Spark job to decrease memory usage.
   • BSwitch all task nodes to on-demand instances to ensure they are not reclaimed by spot interruptions.
   • CIncrease the memory of the driver and executor nodes in the Spark configuration and enable dynamic allocation.
   • DUse CloudWatch Logs Insights to analyze the Spark logs and identify which stage is consuming the most memory.
   Reveal Solution Discussion Select an answer first
4. 18application · medium

   A data engineering team has centralized all application logs from their data pipelines into CloudWatch Logs. They need to identify all log entries that contain the string 'ERROR' and also include the IP address '10.0.0.1' within the last 24 hours. Which approach should they use?

   • AUse the CloudWatch Logs console to manually search each log stream for the required strings.
   • BUse CloudWatch Logs Insights to run a query that filters for 'ERROR' and '10.0.0.1' in the relevant log groups.
   • CCreate a CloudWatch alarm that triggers when the string 'ERROR' appears in the logs.
   • DUse Athena to query the log data directly from the CloudWatch Logs log groups.
   Reveal Solution Discussion Select an answer first
5. 19foundation · easy

   A compliance team requires a record of who performed a specific AWS CLI command that stopped an Amazon EMR cluster. Which AWS service provides this type of audit trail?

   • AAWS CloudTrail
   • BAWS Config
   • CAmazon CloudWatch Logs
   • DAmazon S3 server access logs
   Reveal Solution Discussion Select an answer first
6. 20foundation · easy

   A data engineer notices that an Amazon EMR job is running slower than expected. Which CloudWatch metric would be most useful to check for CPU bottlenecks?

   • ACPUUtilization
   • BDiskReadBytes
   • CNetworkIn
   • DMemoryUtilization
   Reveal Solution Discussion Select an answer first