APEX-Agents · Investment Banking

World226_TA_01

6/6Pass

APEX-Agents task World226_TA_01 in AI Agents for Legal Contract Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Legal Contract ReviewInvestment Banking World 226Dual harnessGrader: rubric

Task IDtask_7d1f9f2c011742dc91dea6e09a29858a

WorldInvestment Banking World 226

Expected outputmake_new_sheet

Published runs4 models · dual config

Task prompt

What the agent was asked to do

Use Planet Fitness' latest financial model, in the"Copy of LBO" tab, and sensitize $ operating expenditure each year by +/- 5% against the base case for each year from 2026 through 2030; calculate the resultant change in FY30 IRR relative to the base case. (For illustration, if opex in FY26 was $1,000, the downside (+5% opex) case would be $1,050 opex and the upside case (- 5% opex) would be $950 opex.) Create a new Sheet and make a table with: - Rows: "Upside", "Base", "Downside" scenarios - Columns: "Scenario"; "IRR"; "Accretion/Dilution" Where "IRR" is the IRR for the given scenario and "Accretion/Dilution" is the difference in the scenario IRR against the base case in absolute % terms. Format all percentages to 2% decimal places

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

Model	Harness	Score	Result	Links
GPT-5.5showcase	dual	6/6	Pass	Share page Public trace
Gemini 3.1 Pro	dual	1/6	Fail	Share page Public trace
GPT-5.4 mini	dual	6/6	Pass	Share page Public trace
GPT-5.4 nano	dual	6/6	Pass	Share page Public trace

Grading rubric

Criteria and grader verdict (showcase run)

States Base scenario IRR is 16.22%
Pass
Evidence: <TEXT_RESPONSE> table lists `Base | 16.22% | 0.00%`. Assessment: Criterion "States Base scenario IRR is 16.22%" is met because the response explicitly states Base IRR as 16.22%.
States Upside scenario IRR is 18.12%
Pass
Evidence: <TEXT_RESPONSE> table lists `Upside | 18.12% | 1.90%`. Assessment: Criterion "States Upside scenario IRR is 18.12%" is met because the response explicitly states Upside IRR as 18.12%.
States Downside scenario IRR is 14.18%
Pass
Evidence: <TEXT_RESPONSE> table lists `Downside | 14.18% | -2.04%`. Assessment: Criterion "States Downside scenario IRR is 14.18%" is met because the response explicitly states Downside IRR as 14.18%.
States the change between the Upside IRR and the Base IRR is 1.90%
Pass
Evidence: <TEXT_RESPONSE> table lists `Upside | 18.12% | 1.90%`. Assessment: Criterion "States the change between the Upside IRR and the Base IRR is 1.90%" is met because the response explicitly states Upside accretion/dilution as 1.90%.
States the accretion/dilution of the Base case is 0.00%
Pass
Evidence: <TEXT_RESPONSE> table lists `Base | 16.22% | 0.00%`. Assessment: Criterion "States the accretion/dilution of the Base case is 0.00%" is met because the response explicitly states Base accretion/dilution as 0.00%.
States the change between the Downside IRR and the Base IRR is -2.04%
Pass
Evidence: <TEXT_RESPONSE> table lists `Downside | 14.18% | -2.04%`. Assessment: Criterion "States the change between the Downside IRR and the Base IRR is -2.04%" is met because the response explicitly states Downside accretion/dilution as -2.04%.