Task 1.3: Orchestrate Data Pipelines DEA-C01 Practice Questions (Page 2)

Questions 6–10

1. 6foundation · easy

   A data pipeline uses an SNS topic to notify a Lambda function when a new file is uploaded to S3. What is the purpose of subscribing the Lambda function to the SNS topic?

   • ATo trigger the Lambda function automatically when a message is published to the topic
   • BTo send a confirmation email to the Lambda function
   • CTo filter messages before they are sent to other subscribers
   • DTo store the notification messages in Lambda
   Reveal Solution Discussion Select an answer first
2. 7expert · hard

   A retail company has a data pipeline that ingests order data from multiple regions. Each region has its own SQS queue. The pipeline processes messages from all queues and loads data into a central data store. The team wants to send a notification to a central SNS topic when a message fails to process after 3 attempts, regardless of which region the message came from. What is the most efficient way to achieve this?

   • ACreate a separate SNS topic for each region and subscribe them to a central SNS topic
   • BUse a single Lambda function that polls all queues and sends a notification on failure
   • CCreate a CloudWatch alarm for each queue and have the alarms publish to the central SNS topic
   • DConfigure each region's SQS queue with a DLQ, and subscribe each DLQ to the central SNS topic
   Reveal Solution Discussion Select an answer first
4. 8application · medium

   A data engineering team is building a serverless workflow using Step Functions. The workflow has a Lambda function that processes files and can occasionally time out. The team wants to implement a timeout and retry mechanism in the state machine. Which configuration should they use?

   • ASet the TimeoutSeconds and Retry fields in the Lambda task state
   • BWrap the Lambda invocation in a loop with a sleep and retry
   • CUse a Lambda destination to send failures to an SQS queue and reprocess
   • DConfigure the Lambda function's timeout and set the state machine's execution timeout
   Reveal Solution Discussion Select an answer first
5. 9application · medium

   A data engineering team is building a workflow using AWS Glue. The workflow has three jobs: JobA, JobB, and JobC. JobB depends on JobA, and JobC depends on both JobA and JobB. The team wants to ensure that if JobB fails, JobC does not run, and the team is notified. What is the best way to implement this?

   • ACreate a Glue workflow with triggers that define the dependencies and add an SNS notification on job failure
   • BSchedule JobB and JobC with EventBridge rules and check the status of JobA before running JobC
   • CUse Step Functions with a Glue job task and a catch block to stop the workflow
   • DRun all jobs in a single Glue job script with conditional logic
   Reveal Solution Discussion Select an answer first
6. 10foundation · easy

   A data pipeline uses an AWS Lambda function to process messages from an Amazon SQS queue. If the Lambda function fails to process a message, what is the recommended pattern to handle the failure without losing the message?

   • AIgnore the failure and continue
   • BConfigure a dead-letter queue (DLQ) on the SQS queue
   • CDelete the message from the queue immediately
   • DUse a Lambda destination to send the failure to SNS
   Reveal Solution Discussion Select an answer first