Professional AI Red Team Reporting COASP Practice Questions (Page 2)

Questions 6–10

1. 6application · medium

   A red team completed an assessment of a healthcare organization's AI-based patient triage system. The executive summary must be presented to the hospital board, which includes non-technical members. The most critical finding is a prompt injection that could cause the system to recommend incorrect urgency levels. Which approach best communicates the risk to this audience?

   • AList all findings in the executive summary with their severity ratings and recommended remediation timelines, so the board can see the full scope of the assessment.
   • BDescribe the technical attack path, including the exact prompt payload and the model's token-level response, so the board understands the mechanism.
   • CExplain that the triage system could be manipulated to misclassify patient urgency, potentially delaying care for critical patients, and note that the issue is being addressed with prioritized fixes.
   • DState that a prompt injection vulnerability was found, rate it as high severity using CVSS, and reference the MITRE ATLAS technique ID in the summary.
   Reveal Solution Discussion Select an answer first
2. 7foundation · easy

   What is the primary goal when presenting evidence in an AI red team report?

   • ATo present evidence only to technical stakeholders
   • BTo provide clear, reproducible evidence that supports the findings without exposing sensitive data
   • CTo show the exact exploit code used in the attack
   • DTo include as much raw data as possible to prove thoroughness
   Reveal Solution Discussion Select an answer first
4. 8application · medium

   You are finalizing an AI red team report for a healthcare client. The client's C-suite will read only the first two pages, while the engineering team will use the rest. The report must align with MITRE ATLAS. Which report structure best satisfies both audiences?

   • AExecutive summary with risk ratings and business impact, followed by methodology, findings mapped to ATLAS techniques, and prioritized recommendations.
   • BTechnical findings first with full attack paths, then a brief executive summary at the end for reference.
   • CA single combined section that merges executive summary, methodology, findings, and recommendations to avoid duplication.
   • DExecutive summary, then a detailed appendix of raw logs, with methodology and recommendations omitted to keep the report short.
   Reveal Solution Discussion Select an answer first
5. 9application · medium

   A red team report for an autonomous vehicle company must describe a physical-world adversarial attack where stickers on a stop sign caused the object detection model to misclassify it as a speed limit sign. In which section of the report should this attack be described in detail, and what should be emphasized?

   • AIn the recommendations section, listing all possible countermeasures without describing the attack itself.
   • BIn the executive summary, emphasizing the technical details of the sticker placement and the model's confidence scores.
   • CIn the methodology section, explaining how the stickers were printed and applied, without discussing the model's response.
   • DIn the technical findings section, emphasizing the attack path, the model's misclassification, and the potential safety impact on vehicle operation.
   Reveal Solution Discussion Select an answer first
6. 10expert · hard

   Your red team report identifies multiple AI security issues: a critical prompt injection vulnerability, a moderate data poisoning risk, and a low-severity model evasion issue. The client has a limited budget and wants to address the most critical issues first. Which recommendation strategy is most appropriate?

   • AFocus only on the low-severity issue because it is easiest to fix.
   • BPrioritize the prompt injection fix first, then plan for data poisoning mitigation, and address model evasion as resources allow.
   • CRecommend that the client wait for the next budget cycle to address any issues.
   • DAddress all issues simultaneously to ensure comprehensive security.
   Reveal Solution Discussion Select an answer first