Tracking and Running ML Experiments PROFESSIONAL-MACHINE-LEARNING-ENGINEER Practice Questions (Page 6)

Questions 26–29

1. 26foundation · easy

   Which automated metric is commonly used to evaluate the similarity between a generated text and a reference text?

   • AAccuracy
   • BF1 score
   • CAUC
   • DBLEU
   Reveal Solution Discussion Select an answer first
2. 27foundation · easy

   What is model lineage?

   • AThe record of data, code, and parameters used to create a model
   • BThe deployment history of a model
   • CThe list of team members who worked on a model
   • DThe history of a model's performance over time
   Reveal Solution Discussion Select an answer first
4. 28foundation · easy

   When designing a prompt for LLM-as-a-judge, what is an important consideration to reduce bias?

   • AProviding clear and specific evaluation criteria
   • BIncluding the model's name in the prompt
   • CUsing a single, fixed prompt for all evaluations
   • DMaking the prompt as short as possible
   Reveal Solution Discussion Select an answer first
5. 29foundation · easy

   What does the AUC (Area Under the ROC Curve) metric measure?

   • AThe model's ability to distinguish between positive and negative classes across all thresholds
   • BThe precision of the model at a specific threshold
   • CThe recall of the model at a specific threshold
   • DThe accuracy of the model at a specific threshold
   Reveal Solution Discussion Select an answer first