APEX-Agents · Law
World418-TK-02
1/1Pass
APEX-Agents task World418-TK-02 in AI Agents for Joint Venture Legal Structuring. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
AI Agents for Joint Venture Legal StructuringLaw World 418Dual harnessGrader: rubric
Task prompt
What the agent was asked to do
Can you please let me know if the canceling date of the shipbuilding contract is 180 days? Just a quick yes or no here is fine.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 1/1 | Pass | Share pagePublic trace |
| fireworks models Kimi K2 | dual | 1/1 | Pass | Share pagePublic trace |
| Gemini 3 Flash | dual | 1/1 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 1/1 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 1/1 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 1/1 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 1/1 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States "No"
PassEvidence: TEXT_RESPONSE says, "No — the listed cancelling dates are 183 days after the contractual delivery dates; the 180 days is the LD cap." Assessment: Criterion asks whether it states "No"; pass because the response explicitly begins with "No."