Raycaster / evalsAll benchmarks

Cross-benchmark category

Tariff and Trade Law Analysis

Compare AI agent runs for Tariff and Trade Law Analysis: prompts, scores, grades, and public traces. This page showcases APEX-Agents tasks that test whether AI agents can reason about tariff exposure, trade law constraints, IEEPA-related disputes, and supply-chain compliance risk.

Trade compliance AIIEEPA tariffs, Court of International Trade, supply-chain tariff exposure
11Tasks
10Primary
1Benchmarks

Published model evidence

A quick view of shareable runs in this category. Open task and trace pages for the prompt, response, files, and grading details.

Kimi K250% pass

4/8 runs · avg score 70%

gpt-5.4-mini45% pass

5/11 runs · avg score 55%

GPT-5.440% pass

4/10 runs · avg score 59%

Gemini 3 Flash38% pass

3/8 runs · avg score 58%

gpt-5.536% pass

4/11 runs · avg score 55%

gpt-5.4-nano36% pass

4/11 runs · avg score 52%

Primary tasks

10 tasks with this category as their main focus.

  1. Task ymtecb81APEX-Agents(task_bf18a6d6ff44489daf0b1c80b5d4a3a8)8/9 · Fail

    Can you take a look at the two Master Supply Agreement templates (Master Supply Agreement Template.pdf ("Template1"), Master Supply Agreement 2.pdf ("Template2"))? We’re considering them for Acme (th…

  2. World132_DA_Task05APEX-Agents(task_3e7800abdba24ed5bbc956024114d229)0/4 · Fail

    Analyse market cost efficiency using the Cost Structure Score methodology for PureLife’s Vitamins strategy: - Calculate the Total Cost Structure Score for each market under the weighted methodology us…

  3. World228_SM_Task06APEX-Agents(task_f58e573d229d46aeaa3edbaf35b7b95b)0/1 · Fail

    Using the 2024 ATR annual report, analyze the results of a 15% tariff on Aptar Group’s FY2024 net income. Assume the 15% applies only to Cost of Sales, exclusive of depreciation and amortization. Roun…

  4. world416_BB_01APEX-Agents(task_0b9134a634c14f24a6c256d034a6c130)2/3 · Fail

    TAC and its supplier executed the first draft of the Master Supply Agreement document (Template 1) as of April 1, 2025. President Trump announced additional tariffs on July 20, 2025. The supplier's r…

  5. World416_DM_01APEX-Agents(task_68bcf4d7fc5045b58045dc9f2f23ce5c)0/3 · Fail

    Due to a riot occurring in response to an Executive Order that resulted in the closure of its factories, TAC sought relief from performance under the force majeure section of the Master Supply Agreeme…

  6. World416_JS_01APEX-Agents(task_2b5df2b5a0eb423e998099a9fcd8e262)2/2 · Pass

    TRIDENT AUTO CORPORATION (The "Plaintiff") has filed a Complaint against United States President Donald Trump (the "Defendant") in the United States District Court for the District of Columbia challen…

  7. World416_JS_02APEX-Agents(task_0097f20dd1744647a5a6e76db215a467)2/2 · Pass

    TRIDENT AUTO CORPORATION (The "Plaintiff") has filed a claim challenging a 25% tariff that President Trump (the "Defendant") imposed on goods imported from China under the International Emergencies Ec…

  8. World416_JS_03APEX-Agents(task_58d04f83ddee4c01bf89a4a1ca0b933a)2/2 · Pass

    TRIDENT AUTO CORPORATION (The "Plaintiff") has filed a claim in the United States District Court for the District of Columbia against several federal government agencies (The "Defendants"). The Claim…

  9. World416_TK_02APEX-Agents(task_3a57257634404d0584a5bd7ce7846b89)0/1 · Fail

    TAC has just informed us that they expect a 20% drop in gross margin due to import tariffs. TAC has posted the information on their website as they have done in the past. Write me back a brief message…

  10. World416_TK_04APEX-Agents(task_5eec5f9ff1234067859443ab0a6c402d)1/2 · Fail

    Review the two supply agreement templates, Master Supply Agreement Template 1.docx and Master Supply Agreement Template 4.pdf, along with the attached files (UCC §2-209 and Restatement (Second) of Con…

Related tasks

1 tasks that also exercise this work as part of a broader assignment.

  1. World112-1_Task04_TBAPEX-Agents(task_d7893ddf035a4abca2990717ad4d7428)4/4 · Pass

    Given the US imposed tariffs on the import of pharmaceutical materials from Germany, India, China at the rates 10%, 15%, 20% respectively, determine the impact of tariffs as a percent increase in pred…