Task 1.4: Apply Programming Concepts DEA-C01 Practice Questions (Page 3)

Questions 11–15

1. 11foundation · easy

   A data pipeline is failing intermittently in production. To diagnose the issue, a data engineer needs to see detailed information about the pipeline's execution, including input data, error messages, and processing steps. Which practice is most directly helpful?

   • AVersion control
   • BCode review
   • CLogging
   • DUnit testing
   Reveal Solution Discussion Select an answer first
2. 12foundation · easy

   A Lambda function processes messages from an Amazon SQS queue. To ensure that the function can handle a burst of incoming messages without being throttled, which configuration should a data engineer set?

   • AA larger memory setting
   • BA longer timeout
   • CReserved concurrency
   • DAn SQS event source mapping with a batch size of 1
   Reveal Solution Discussion Select an answer first
4. 13foundation · easy

   A data engineering team wants to automatically build and test their pipeline code every time a developer pushes changes to the repository, and then deploy to a staging environment. Which practice does this describe?

   • AManual deployment
   • BContinuous integration (CI)
   • CInfrastructure as Code
   • DContinuous delivery (CD)
   Reveal Solution Discussion Select an answer first
5. 14foundation · easy

   A data engineer is writing a Python script to transform a large dataset. The current implementation processes each row in a loop, which is slow. Which technique is most directly aimed at reducing runtime by processing multiple data elements simultaneously?

   • ACompressing the input files
   • BVectorization
   • CUsing a larger instance type
   • DAdding more logging statements
   Reveal Solution Discussion Select an answer first
6. 15expert · hard

   A data engineering team has a production pipeline that runs nightly. The team recently introduced a new transformation step. After deployment, the pipeline failed due to an unhandled exception. The team wants to ensure that future changes are tested and deployed safely. Which combination of practices should the team implement?

   • AUse a larger instance type for the pipeline to avoid resource-related failures.
   • BSchedule the pipeline to run every hour to detect failures sooner.
   • CAdd more logging to the pipeline and monitor CloudWatch logs.
   • DAdd unit tests, integrate them into a CI pipeline, and use a blue/green deployment strategy.
   Reveal Solution Discussion Select an answer first