APEX-Agents · Law
World419_DM_02
APEX-Agents task World419_DM_02 in AI Agents for Maritime and Environmental Liability. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
Evaluate the maximum total potential liability for Star Tankers International Ltd. compared to Cooper/Jeffries Energy Corporation under the Oil Pollution Act for the incident with the M/V Red Room. Draft a message to me here, stating which entity has a greater liability if found to be the sole responsible party for the incident with the M/V Red Room. Calculate and include the potential maximum liability for each party. Give the values in 100s. Use the BLPL Claim Summary, the relevant legal authority, and the Hull and Machinery Survey for your analysis.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 1/3 | Fail | Share pagePublic trace |
| fireworks models Kimi K2 | dual | 1/3 | Fail | Share pagePublic trace |
| Gemini 3 Flash | dual | 3/3 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 1/3 | Fail | Share pagePublic trace |
| GPT-5.4 mini | dual | 3/3 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 3/3 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States that the maximum potential liability for Star Tankers International Ltd. under the Oil Pollution Act is $56,709,300
PassEvidence: TEXT_RESPONSE states, “if Star Tankers is the sole responsible party and remains entitled to OPA limitation, its maximum potential OPA liability is $56,709,300” and shows “29,847 GT × $1,900 = $56,709,300.” Assessment: Criterion requires stating Star Tankers’ maximum potential liability under OPA is $56,709,300; pass.
States that the maximum potential liability for Cooper/Jeffries Energy Corporation under the Oil Pollution Act is $56,709,300
FailEvidence: TEXT_RESPONSE says for Cooper/Jeffries, “its maximum exposure would be the full BLPL Claim Summary amount: $144,140,000,” and the bottom line says “Cooper/Jeffries has the greater potential maximum liability… $144,140,000.” It only adds conditionally, “If a court instead treats Cooper/Jeffries as subject to the same OPA tank-vessel cap… $56,709,300.” Assessment: Criterion requires stating Cooper/Jeffries’ maximum potential liability under OPA is $56,709,300; the response’s actual conclusion is $144,140,000, so fail.
States that neither Star Tankers International Ltd. nor Cooper/Jeffries Energy Corporation have greater potential liability under the Oil Pollution Act as their maximum liability is equal
FailEvidence: TEXT_RESPONSE concludes, “Bottom line: Cooper/Jeffries has the greater potential maximum liability… $144,140,000 versus Star Tankers’ capped $56,709,300.” It includes only a caveat that if Cooper/Jeffries gets the same cap, “the capped amount would be the same.” Assessment: Criterion requires stating neither entity has greater potential liability because their maximum liability is equal; the response states Cooper/Jeffries is greater, so fail.