Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.5 · dual

World419_UM_03

4/6Fail

GPT-5.5 on APEX-Agents: World419_UM_03 (dual harness). Browse score, rubric, and public trace.

4/6 · Fail
Law
AI Agents for Maritime and Environmental Liability
Law World 419

Grader rubric

Criteria verdict

  1. States that the Protection & Indemnity Insurance Policy will cover the cleanup costs incurred by Cooper/Jeffries as a result of the M/V Red Room incident

    Fail
  2. States that the Marine Pollution Legal Liability Insurance Policy will cover the cleanup costs incurred by Cooper/Jeffries as a result of the M/V Red Room incident

    Pass
  3. States that the Protection & Indemnity Insurance Policy will cover the costs incurred by Cooper/Jeffries to settle Captain Jack Sparrow's claim

    Fail
  4. States that the Marine Pollution Legal Liability Insurance Policy will cover the costs incurred by Cooper/Jeffries to settle Captain Jack Sparrow's claim

    Pass
  5. States that the Marine Excess Liability Insurance Policy may provide excess coverage for the cleanup costs incurred by Cooper/Jeffries as a result of the M/V Red Room incident

    Pass
  6. States that the Marine Excess Liability Insurance Policy may provide excess coverage for the costs incurred by Cooper/Jeffries to settle Captain Jack Sparrow's claim

    Pass

Prompt excerpt

Task context

Following the M/V Red Room incident, Cooper/Jeffries incurred $1,800,000 in cleanup costs. The company equally settled a claim in the amount of $295,000 from Captain Jack Sparrow, a fisherman whose boat and equipment were damaged as a result of the incident; Cooper/Jeffries paid a $128,375 penalty on behalf of Martin Dee, captain of the M/V Red Room, for his role in the incident. Cooper/Jeffries seeks to recoup all sums paid from Black Lodge Petroleum Logistics ("BLPL"). Review all the insurance policies contained in the Risk Management Counsel folder and BLPL's Umbrella Insurance Policy. Concisely determine which, if any, of the insurance policies will cover the cleanup costs incurred as a result of the M/V Red Room incident, and the amount paid to settle Sparrow's claim. Reply to me with your assessment.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace