Professional AI Red Team Reporting COASP Practice Questions (Page 8)

Questions 36–40

1. 36application · medium

   A red team found that an AI-based spam filter can be bypassed by appending a specific string of characters to the subject line. The technical team needs to reproduce the issue and verify the fix. What should the technical findings section include?

   • AThe exact string used, the email client and server configuration, the model version, and the steps to reproduce the bypass.
   • BA screenshot of the spam email in the inbox, but no description of the exact string or configuration.
   • CA general description of the bypass and a recommendation to update the spam filter, without specific technical details.
   • DThe model's training data and a list of all emails that were incorrectly classified as spam.
   Reveal Solution Discussion Select an answer first
2. 37expert · hard

   A red team report for a self-driving car company must describe an adversarial attack that caused the vehicle to misidentify a pedestrian as a tree. The company's legal team is concerned about liability, and the engineering team wants to know how to fix the issue. The report must balance technical detail with legal implications. What is the best approach?

   • ADocument the attack in the technical findings section with full technical detail, and include a separate section on legal and liability implications for the legal team.
   • BInclude the technical details in the executive summary so that the legal team can quickly understand the risk.
   • COmit the technical details and focus only on the legal implications, since the legal team is the primary audience.
   • DProvide the technical details only in a verbal briefing to the engineering team and include only the legal implications in the written report.
   Reveal Solution Discussion Select an answer first
4. 38application · medium

   You are writing a red team report for a client that requires alignment with industry frameworks. The client specifically asks that findings be mapped to MITRE ATLAS. What is the primary benefit of this alignment?

   • AIt replaces the need for a detailed executive summary.
   • BIt automatically fixes the vulnerabilities identified during the assessment.
   • CIt provides a standardized language and structure that makes the report more credible and easier for other security professionals to understand.
   • DIt guarantees that the report will be accepted by all regulatory bodies.
   Reveal Solution Discussion Select an answer first
5. 39application · medium

   You are preparing the evidence appendix for a red team report on a data poisoning attack. The evidence includes malicious training samples that contain personal information. How should you present this evidence?

   • AInclude redacted samples that show the structure and content type of the malicious data, along with hashes of the original samples.
   • BInclude the full unredacted samples to provide complete evidence of the attack.
   • CDescribe the samples in text only, without any actual data or hashes.
   • DProvide a link to the full dataset stored on a public cloud share.
   Reveal Solution Discussion Select an answer first
6. 40application · medium

   You are writing the executive summary for a red team assessment of a financial institution's fraud-detection model. The model was found vulnerable to evasion attacks that could allow fraudulent transactions to slip through. The audience is the board of directors, who are not technical. What is the most effective way to communicate this finding?

   • AExplain that the model failed several adversarial robustness tests and that the red team recommends implementing adversarial training.
   • BDescribe the specific adversarial perturbation algorithm used and the exact decision boundary changes observed in the model.
   • CState that the model is vulnerable to evasion and recommend immediate retraining, without discussing potential financial impact.
   • DState that an attacker could potentially bypass the fraud-detection model to approve fraudulent transactions, leading to financial losses, and explain that the risk is currently moderate with mitigations available.
   Reveal Solution Discussion Select an answer first