Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.5 · dual

World 419_UM_02

0/2Fail

GPT-5.5 on APEX-Agents: World 419_UM_02 (dual harness). Browse score, rubric, and public trace.

0/2 · Fail
Law
AI Agents for Maritime and Environmental Liability
Law World 419

Grader rubric

Criteria verdict

  1. States that Yes, the imposed penalty of $128,375 will be covered under the policies

    Fail
  2. States that the total amount payable by MARINEX to Cooper/Jeffries is payable under both of these policies: (1) the Protection and Indemnity Insurance Policy and (2) the Marine Pollution Legal Liability Insurance Policy

    Fail

Prompt excerpt

Task context

I need your help determining how much will be covered by MARINEX under our current insurance policies, between the cleanup costs incurred after the incident and Jack Sparrow's claim. Please see if Captain Dee's imposed penalty of $128,375 will also be covered under both our policies. Reply back with your findings. Thank you!

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace