What is the primary purpose of Amazon Bedrock's Model Evaluation feature?

To manage access permissions for foundation models

To fine-tune foundation models on custom datasets

To automate the evaluation of foundation models using built-in or custom metrics

To deploy foundation models to production

What does the BLEU metric primarily evaluate?

Semantic similarity using embeddings

The safety of generated content

Machine translation quality by measuring n-gram precision

Which of the following is a potential advantage of using LLM-as-a-judge over human evaluation?

It eliminates the need for any reference outputs

It can be more scalable and cost-effective for large-scale evaluation

It guarantees unbiased evaluations

It is always more accurate than human judgment

AWSCertified AI Practitioner

Domain 3Objective 4

Task Statement 3.4: Describe Methods to Evaluate FM Performance. AIF-C01 Practice Questions (Page 6)

Part of the Content Domain 3: Applications of Foundation Models domain, which makes up ~32% of our current practice bank. AWS does not publish an official question count, but from its 90-minute exam (~35–60 total, ~11–19 in this domain), expect 3–5 from this objective — we provide 40 practice questions to prepare you well beyond it. (estimate)

40questions here

8free pages

14concepts

Questions 26–30

26foundation · easy
What is the primary purpose of Amazon Bedrock's Model Evaluation feature?
Select an answer first
27foundation · easy
What does the BLEU metric primarily evaluate?
Select an answer first
28foundation · easy
If an AI assistant successfully completes 80 out of 100 user requests, what is its task completion rate?
Select an answer first
29foundation · easy
Which of the following is a potential advantage of using LLM-as-a-judge over human evaluation?
Select an answer first
30application · medium
A startup has deployed a customer support chatbot. They want to evaluate the financial efficiency of the chatbot by measuring the average cost incurred for each user interaction. Which metric should they use?
Select an answer first

Finished these 5 questions?

Review the revealed explanations, or continue through the curriculum.

Next 5 questions →Back to AIF-C01

Free Basic Practice is a study aid with revealable answers — not a scored exam. Examers.io is independent and not affiliated with or endorsed by AWS. “AIF-C01” is a trademark of its owner, used for identification only.

Task Statement 3.4: Describe Methods to Evaluate FM Performance. AIF-C01 Practice Questions (Page 6)

Questions 26–30

What is the primary purpose of Amazon Bedrock's Model Evaluation feature?

What does the BLEU metric primarily evaluate?

If an AI assistant successfully completes 80 out of 100 user requests, what is its task completion rate?

Which of the following is a potential advantage of using LLM-as-a-judge over human evaluation?

A startup has deployed a customer support chatbot. They want to evaluate the financial efficiency of the chatbot by measuring the average cost incurred for each user interaction. Which metric should they use?

Keep studying — Content Domain 3: Applications of Foundation Models