Task 1.4: Apply Programming Concepts DEA-C01 Practice Questions (Page 7)

Questions 31–33

1. 31application · medium

   A data engineering team needs to process a 10 TB dataset stored in S3. The transformation is embarrassingly parallel, meaning each record can be processed independently. The team wants to minimize the total processing time. Which approach should the team use?

   • AUse an AWS Database Migration Service (DMS) task to transform the data.
   • BUse a Lambda function with 10,240 MB of memory to process the entire dataset.
   • CUse AWS Glue to run the transformation as a distributed job across multiple workers.
   • DUse a single EC2 instance with a large instance type to process the data sequentially.
   Reveal Solution Discussion Select an answer first
2. 32foundation · easy

   A Lambda function needs to access a shared file system to store and read large files that exceed the function's temporary storage limit. Which AWS service can be mounted to a Lambda function to provide a scalable, shared file system?

   • AAmazon S3
   • BAmazon EFS
   • CAmazon EBS
   • DAmazon DynamoDB
   Reveal Solution Discussion Select an answer first
3. 33application · medium

   A data engineer is writing a Python script that reads a large CSV file from S3 and performs a simple filter operation. The script currently uses the csv module to read row by row. The engineer wants to improve performance. Which change should the engineer make?

   • AUse a Lambda function to process the file.
   • BUse the csv module but increase the buffer size.
   • CUse a Bash script with awk to filter the file.
   • DUse pandas to read the CSV file and apply the filter with a vectorized operation.
   Reveal Solution Discussion Select an answer first