Scoping an AI Red Team Exercise and Threat Modeling COASP Practice Questions (Page 1)

Questions 1–5

1. 1foundation · easy

   Which of the following is considered an AI system asset that should be enumerated during red team scoping?

   • AThe CEO's personal laptop
   • BThe office coffee machine's IP address
   • CThe organization's marketing brochures
   • DThe training dataset used to build the model
   Reveal Solution Discussion Select an answer first
2. 2expert · hard

   A red team is planning an exercise for an AI system that uses a large language model to generate legal documents. The system is used by a law firm and must comply with attorney-client privilege. The red team has identified two threats: (1) the model could leak privileged information from its training data, and (2) an attacker could use prompt injection to make the model generate incorrect legal advice. The firm's main concern is client trust. Which threat should be prioritized?

   • ANeither threat, because the red team should focus on technical vulnerabilities, not business risks.
   • BThe prompt injection threat, because it is easier to execute and could cause immediate harm.
   • CThe data leakage threat, because a leak of privileged information would be a severe breach of confidentiality and could destroy client trust.
   • DBoth threats equally, because they both affect client trust.
   Reveal Solution Discussion Select an answer first
4. 3foundation · easy

   What is the primary purpose of documenting assumptions in an AI red team exercise?

   • ATo communicate what the red team believes to be true about the system and environment
   • BTo provide a basis for evaluating the exercise's success
   • CTo record the personal opinions of the red team members
   • DTo list all the tools the red team will use
   Reveal Solution Discussion Select an answer first
5. 4application · medium

   An e-commerce company uses an AI recommendation system. The red team has identified several threats: (1) an attacker could manipulate product reviews to bias recommendations, (2) an attacker could cause a denial of service by sending excessive requests to the recommendation API, (3) an insider could steal the training data, and (4) a minor UI bug could display incorrect product names. The team has limited time. Which threat should be prioritized for red team testing?

   • AThe minor UI bug, because it is easy to fix and should be addressed first.
   • BDenial of service on the recommendation API, because it is easy to execute and would cause immediate downtime.
   • CManipulating product reviews to bias recommendations, because it directly affects the system's core function and could have broad business impact.
   • DInsider theft of training data, because data breaches are always the most severe threat.
   Reveal Solution Discussion Select an answer first
6. 5foundation · easy

   Which of the following best describes how an AI red team exercise scope should relate to the organization's business context?

   • AThe scope should focus only on technical vulnerabilities, ignoring business impact
   • BThe scope should be identical for every AI system in the organization
   • CThe scope should be independent of business goals to ensure unbiased testing
   • DThe scope should support the organization's security objectives and business priorities
   Reveal Solution Discussion Select an answer first