Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.4 · dual

Task iv36a08a

1/7Fail

GPT-5.4 on APEX-Agents: Task iv36a08a (dual harness). Browse score, rubric, and public trace.

1/7 · Fail
Law
AI Agents for SEC Disclosure Analysis
Law World 415

Grader rubric

Criteria verdict

  1. States that Count 1 is Not Covered

  2. States that Count 2 is Not Covered

  3. States that Count 3 is Not Covered

  4. States that Count 4 is Not Covered

  5. States that Count 5 is Covered

  6. States that Count 6 is Not Covered

  7. States that Count 7 is Not Covered

Prompt excerpt

Task context

Analyze whether Counts 1-7 of Delta's Complaint against CrowdStrike fall within the limitation of liability clause in Section 10.1 of CrowdStrike's standard MSA, indicating "Covered" or "Not Covered" for each count. Reply back to me here with your assessments.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace