Raycaster / evalsBack to AI Agents for Legal Contract Review

APEX-Agents · Investment Banking

World226_TD_04

0/4Fail

APEX-Agents task World226_TD_04 in AI Agents for Legal Contract Review. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for Legal Contract ReviewInvestment Banking World 226Dual harnessGrader: rubric
Task IDtask_875a2e79bb1a4807828c8324ae4c85c0
WorldInvestment Banking World 226
Expected outputmessage_in_console
Published runs4 models · dual config

Task prompt

What the agent was asked to do

Conduct a 5-year IRR sensitivity analysis using Planet Fitness' latest financial model that Advent updated based on their specifications (v7). Assess the IRR impact to Advent if the terms of the debt raised changed while keeping 10% offer price premium and 18x exit multiple. Calculate the 5-year IRR when Debt Raised at Close at 6.5x, 7.0x EBITDA and interest rate at 6.5% and 7%. You can use a "Copy of LBO" tab. Round all calculated numbers to one decimal place. Reply back to me here with the information I've asked for.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/4FailShare pagePublic trace
Gemini 3.1 Produal0/4FailShare pagePublic trace
GPT-5.4 minidual0/4FailShare pagePublic trace
GPT-5.4 nanodual0/4FailShare pagePublic trace

Grading rubric

Criteria and grader verdict (showcase run)

  1. States the 5-year IRR if Sponsor raised 6.5x EBITDA of Debt at 6.5% Interest Rate is 20.1%

    Fail

    Evidence: <TEXT_RESPONSE> table states for “6.5x EBITDA” and “6.5% Interest Rate” the IRR is “19.0%.” Assessment: Criterion requires stating the 5-year IRR is 20.1%; the response states 19.0%, so this fails.

  2. States the 5-year IRR if Sponsor raised 7.0x EBITDA of Debt at 6.5% Interest Rate is 20.7%

    Fail

    Evidence: <TEXT_RESPONSE> table states for “7.0x EBITDA” and “6.5% Interest Rate” the IRR is “19.7%.” Assessment: Criterion requires stating the 5-year IRR is 20.7%; the response states 19.7%, so this fails.

  3. States the 5-year IRR if Sponsor raised 6.5x EBITDA of Debt at 7.0% Interest Rate is 20.0%

    Fail

    Evidence: <TEXT_RESPONSE> table states for “6.5x EBITDA” and “7.0% Interest Rate” the IRR is “18.9%.” Assessment: Criterion requires stating the 5-year IRR is 20.0%; the response states 18.9%, so this fails.

  4. States the 5-year IRR if Sponsor raised 7.0x EBITDA of Debt at 7.0% Interest Rate is 20.7%

    Fail

    Evidence: <TEXT_RESPONSE> table states for “7.0x EBITDA” and “7.0% Interest Rate” the IRR is “19.5%.” Assessment: Criterion requires stating the 5-year IRR is 20.7%; the response states 19.5%, so this fails.