Define Operations and Sequence to Write Given Chunked Text into Delta Lake Tables in Unity Catalog GENERATIVE-AI-ENGINEER-ASSOCIATE Practice Questions (Page 3)

Questions 11–15

1. 11application · medium

   A data engineer is writing a DataFrame of chunked text to a Delta Lake table in Unity Catalog. They need to ensure that the write operation is idempotent, so that re-running the pipeline does not create duplicate rows. Which approach should they use?

   • AUse a Delta Lake MERGE operation with a unique key column to insert new chunks and update existing ones.
   • BUse the 'append' write mode and rely on the pipeline to run only once.
   • CUse the 'append' write mode and then run a deduplication query after the write.
   • DUse the 'overwrite' write mode with a unique key column.
   Reveal Solution Discussion Select an answer first
2. 12foundation · easy

   In a typical pipeline that stores chunked text in Delta Lake, which step comes immediately before writing the DataFrame to the table?

   • AApplying a Unity Catalog permission grant
   • BCreating the Delta table schema
   • CLoading the raw text file
   • DChunking the text into smaller pieces
   Reveal Solution Discussion Select an answer first
4. 13foundation · easy

   What is the primary purpose of chunking large text documents before storing them in a Delta Lake table for a generative AI application?

   • ATo create smaller, manageable units that fit within model context windows and enable efficient retrieval
   • BTo encrypt the text so that only authorized users can read it
   • CTo reduce the total storage size of the text data in the table
   • DTo convert unstructured text into a structured tabular format with fixed columns
   Reveal Solution Discussion Select an answer first
5. 14foundation · easy

   Which of the following best describes a common approach to chunking text for storage in a Delta Lake table?

   • AStoring the entire document as a single row without any splitting
   • BRandomly selecting sentences from the document to form new paragraphs
   • CCompressing the text using gzip before writing it to the table
   • DSplitting text into fixed-size character or token windows, often with overlap between consecutive chunks
   Reveal Solution Discussion Select an answer first
6. 15expert · hard

   A team is building a pipeline that processes a large corpus of text files. The pipeline must be able to resume from where it left off if it fails, and it must not reprocess files that have already been chunked and written to the Delta Lake table. Which approach should they use?

   • AUse a batch job that reads all files and writes with 'append' mode, relying on deduplication.
   • BUse a batch job that reads all files and writes with 'overwrite' mode.
   • CUse a scheduled job that reads files modified in the last hour and writes with 'append' mode.
   • DUse Auto Loader to incrementally ingest new files and write the chunked data with 'append' mode.
   Reveal Solution Discussion Select an answer first