Hands-On Exercise: Exploratory Testing and Exploratory Data Analysis (EDA) CT-AI Practice Questions (Page 6)

Questions 26–26

1. 26expert · hard

   A team is testing an AI system that translates legal documents. Exploratory testing reveals that the system makes significant errors on documents with complex, nested clauses. EDA shows that the training data contains mostly short, simple sentences. The team has a limited budget for new data collection. What is the most effective integrated strategy?

   • ARetrain the model from scratch with a larger, more powerful transformer architecture.
   • BConduct more exploratory testing to find all possible error types before making any changes.
   • CUse EDA to quantify the sentence-length distribution, use exploratory testing to identify the specific error types, and then prioritize collecting a small set of complex documents for fine-tuning.
   • DImplement a rule-based post-processing step to split complex sentences into simpler ones before translation.
   Reveal Solution Discussion Select an answer first