Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.5 · dual

World418-TK-01

1/2Fail

GPT-5.5 on APEX-Agents: World418-TK-01 (dual harness). Browse score, rubric, and public trace.

1/2 · Fail
Law
AI Agents for Maritime and Environmental Liability
Law World 418

Grader rubric

Criteria verdict

  1. States No, the LNG carriers built by Nakamura Heavy Industries cannot be used in Jones Act Trade

    Pass
  2. States Yes, the LNG carrier built in 1992 in France can be used in Jones Act Trade solely between the U.S. and Puerto Rico

    Fail

Prompt excerpt

Task context

Can you please assess whether or not the new LNG carries built by Nakamura Heavy Industries can be used in Jones Act Trade? Additionally, BlueLNG JV purchased another LNG vessel and asks whether it can be used in Jones Act Trade as well. It was built in 1992 in France. Please give me your reply right back here.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace