Raycaster / evalsTask overviewAPEX-AgentsCategory

APEX-Agents · GPT-5.4 · dual

World416_DM_01

0/3Fail

GPT-5.4 on APEX-Agents: World416_DM_01 (dual harness). Browse score, rubric, and public trace.

0/3 · Fail
Law
AI Agents for Tariff and Trade Law Analysis
Law World 416

Grader rubric

Criteria verdict

  1. States that the language in Section 11 (Force Majeure) of the Master Supply Agreement Template 1 does not need to be updated

  2. States that "government actions" in the Force Majeure section of the Master Supply Agreement Template 1 would cover the type of government executive order that was at issue in Vance v. Diversified Invs

  3. States that no changes to the Force Majeure section are necessary

Prompt excerpt

Task context

Due to a riot occurring in response to an Executive Order that resulted in the closure of its factories, TAC sought relief from performance under the force majeure section of the Master Supply Agreement. Citing the attached case, Buyer asserts that TAC is not excused from performance. Is Buyer correct? Provide your response in here with the following: "Yes/No"; and brief explanation.

Response trace

Agent response, tools, files, and edits

Open full trace

On mobile, open the full trace for the best view of the agent response, tool calls, file reads, edits, and grading context.

Open mobile trace