Explain the Approaches for Bringing Data into Databricks, Covering Ingestion from S3, Data Sharing with External Systems via Delta Sharing, API-driven Data Intake, the Auto Loader Feature, and Marketplace. DATA-ANALYST-ASSOCIATE Practice Questions (Page 4)

Questions 16–20

1. 16foundation · easy

   A data analyst needs to read a CSV file stored in an S3 bucket from a Databricks notebook. Which approach directly reads the file without creating a permanent mount point?

   • AUse the Azure Blob Storage connector with the s3:// URI
   • BUse spark.read.format("csv").load("s3a://bucket/path/file.csv") with appropriate credentials configured
   • CUse the dbutils.fs.mount() command to mount the bucket, then read the file via /mnt/
   • DUse the Databricks CLI to copy the file to DBFS before reading
   Reveal Solution Discussion Select an answer first
2. 17application · medium

   A SaaS company needs to ingest event data from an external REST API into a Databricks Delta table. The API returns JSON payloads and requires an OAuth token. The ingestion must run on a schedule and handle pagination. Which approach should the team use?

   • AWrite a Python notebook that calls the API, handles pagination, and writes the results to a Delta table, then schedule it as a Databricks job.
   • BMount the API endpoint as a file system and use SQL to query it.
   • CUse Auto Loader to read the API endpoint directly as a data source.
   • DUse the Databricks Marketplace to import the API data.
   Reveal Solution Discussion Select an answer first
4. 18application · medium

   A data scientist is looking for a dataset of global weather patterns to train a model. They want to find a dataset that is regularly updated and has good documentation. They prefer to use a curated source rather than scraping the web. What should they use?

   • AA web scraper to collect data from a weather website.
   • BDelta Sharing to request a share from a weather data provider.
   • CAuto Loader to ingest data from a public weather API.
   • DDatabricks Marketplace to search for and import a weather dataset.
   Reveal Solution Discussion Select an answer first
5. 19expert · hard

   A team is using Auto Loader to ingest files from an S3 bucket. They notice that some files are being processed multiple times, causing duplicate records in the Delta table. They are using directory listing mode. What is the most likely cause of the duplicates?

   • AThe Delta table is not using a primary key.
   • BThe team is using a full refresh instead of incremental mode.
   • CThe S3 bucket has files with the same name in different folders.
   • DThe Auto Loader checkpoint is not being persisted correctly, so it re-lists and reprocesses files.
   Reveal Solution Discussion Select an answer first
6. 20application · medium

   A team needs to regularly read a large dataset from an S3 bucket for daily reporting. They want to minimize the complexity of their code by using a simple path like '/mnt/reports'. They also need to ensure that the data is accessible across multiple clusters. What should they do?

   • AUse Auto Loader to ingest the data into a Delta table.
   • BUse direct S3 access with IAM roles in every notebook.
   • CMount the S3 bucket to DBFS and use the mount path in their queries.
   • DUse the Databricks Marketplace to import the S3 data.
   Reveal Solution Discussion Select an answer first