Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.5 · dual

Task acg14a6c

5/6Fail

GPT-5.5 on APEX-Agents: Task acg14a6c (dual harness). Browse score, rubric, and public trace.

5/6 · Fail
Law
AI Agents for Privacy and GDPR Compliance
Law World 415

Grader rubric

Criteria verdict

  1. States that section 8.4 of the MSA does not protect CrowdStrike from their own mistakes

    Pass
  2. States that Section 10.1 of the MSA limits liability for all of the following: (1) lost revenue and (2) lost data damages

    Pass
  3. States that the customer's email does not meet the contractual delivery requirements in Section 14.7 of the MSA

    Pass
  4. States that CrowdStrike is liable under section 8.4 of the MSA

    Fail
  5. States that CrowdStrike is not liable under Section 10.1 of the MSA

    Pass
  6. States that CrowdStrike is not liable under Section 14.7 of the MSA

    Pass

Prompt excerpt

Task context

Can you review Sections 8.4, 9.1, 9.3,10.1,14.7 in our MSA, against the below outage scenario? A faulty update causes endpoint failures. The customer sends a breach notice by email to a support inbox, seeks lost revenue and lost data costs and asserts that CrowdStrike must indemnify all losses. For each of the clauses that applies to the facts above, state whether CrowdStrike is liable or not, and provide a one-sentence reason for the conclusion. Put it in a new doc file you create.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace