APEX-Agents · Law
World416_JS_02
APEX-Agents task World416_JS_02 in AI Agents for Tariff and Trade Law Analysis. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.
Task prompt
What the agent was asked to do
TRIDENT AUTO CORPORATION (The "Plaintiff") has filed a claim challenging a 25% tariff that President Trump (the "Defendant") imposed on goods imported from China under the International Emergencies Economic Powers Act (IEEPA). The case is being heard by Judge Rudolph Contreras in the United States District Court for the District of Columbia. Will the Plaintiff succeed in challenging the tariff? Provide me with a yes or no answer and a single sentence explanation. Reply straight back here.
Published trajectories
Agent runs on this task
Curated dual-harness runs (parsed + original sandbox). Best scored run per model.
| Model | Harness | Score | Result | Links |
|---|---|---|---|---|
| GPT-5.5showcase | dual | 2/2 | Pass | Share pagePublic trace |
| fireworks models Kimi K2 | dual | 2/2 | Pass | Share pagePublic trace |
| Gemini 3 Flash | dual | 2/2 | Pass | Share pagePublic trace |
| Gemini 3.1 Pro | dual | 2/2 | Pass | Share pagePublic trace |
| GPT-5.4 | dual | 2/2 | Pass | Share pagePublic trace |
| GPT-5.4 mini | dual | 2/2 | Pass | Share pagePublic trace |
| GPT-5.4 nano | dual | 2/2 | Pass | Share pagePublic trace |
Grading rubric
Criteria and grader verdict (showcase run)
States Yes, the Plaintiff will succeed in challenging the tariff
PassEvidence: TEXT_RESPONSE says, “Yes — the Plaintiff is likely to succeed...” Assessment: The criterion requires stating Yes, the Plaintiff will succeed in challenging the tariff; pass because the response clearly answers yes and says likely to succeed.
States that the International Emergencies Economic Powers Act does not authorize the president to impose tariffs
PassEvidence: TEXT_RESPONSE says, “IEEPA does not authorize the President to impose tariffs on imported goods.” Assessment: The criterion requires stating that IEEPA does not authorize the president to impose tariffs; pass because the response states this directly.