Explain the Approaches for Bringing Data into Databricks, Covering Ingestion from S3, Data Sharing with External Systems via Delta Sharing, API-driven Data Intake, the Auto Loader Feature, and Marketplace. DATA-ANALYST-ASSOCIATE Practice Questions (Page 1)

Questions 1–5

1. 1application · medium

   A logistics company receives GPS tracking files in an S3 bucket. The files are appended every few minutes. The team wants to build a streaming pipeline that processes each file exactly once and maintains a Delta table of all events. Which approach should they use?

   • AUse a Python script to copy files to DBFS and then read them.
   • BUse Delta Sharing to stream the files from S3.
   • CUse Auto Loader with a structured streaming query to continuously read new files and write to a Delta table.
   • DUse a scheduled batch job that reads all files and overwrites the Delta table.
   Reveal Solution Discussion Select an answer first
2. 2application · medium

   A retail analytics team stores daily transaction files in an S3 bucket. The files arrive in the bucket throughout the day, and the team needs to process only the newly arrived files every 30 minutes without reprocessing the entire dataset. They also want to avoid managing any external infrastructure for change detection. Which approach should they use?

   • AManually copy new files to a DBFS location and use a Delta table to track changes.
   • BUse Auto Loader with a file notification service to incrementally ingest new files from the S3 bucket.
   • CMount the S3 bucket and run a full read of all files in the bucket every 30 minutes.
   • DUse the Databricks SQL connector to query the S3 bucket directly every 30 minutes.
   Reveal Solution Discussion Select an answer first
4. 3application · medium

   A data engineering team is setting up a pipeline to ingest JSON files from an S3 bucket. The files are added continuously, and the team wants to process them as they arrive. They also need to handle schema evolution automatically. Which feature should they use?

   • AA one-time full load using a Spark read from S3.
   • BDelta Sharing to stream data from the S3 bucket.
   • CA scheduled job that reads all files and overwrites the Delta table.
   • DAuto Loader with schema inference and evolution enabled.
   Reveal Solution Discussion Select an answer first
5. 4foundation · easy

   Which component does Auto Loader use to track which files have already been processed?

   • AAn external database
   • BA Delta table
   • CA checkpoint directory
   • DA mount point
   Reveal Solution Discussion Select an answer first
6. 5foundation · easy

   What is the primary purpose of Databricks Marketplace?

   • ATo discover and import datasets published by other organizations
   • BTo store data in the cloud
   • CTo share your own data with external partners
   • DTo run machine learning models
   Reveal Solution Discussion Select an answer first