Raycaster / evalsBack to AI Agents for M&A Legal Due Diligence

APEX-Agents · Investment Banking

World226_RM_07

0/6Fail

APEX-Agents task World226_RM_07 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for M&A Legal Due DiligenceInvestment Banking World 226Dual harnessGrader: rubric
Task IDtask_9a0a006403cc4216ad6031eec47d3241
WorldInvestment Banking World 226
Expected outputedit_existing_sheet
Published runs4 models · dual config

Task prompt

What the agent was asked to do

Use the LBO analysis, update it to assume that Planet Fitness stock option tranches outstanding. I want to see the Year 5 IRR, flexing premium paid and exit multiple. # Assumptions -All options are vested or will vest in the event of a transaction -3 tranches of stock options outstanding: *5.0 million shares at a strike of $105.00/share *4.0 million shares at a strike of $110.00/share *5.0 million shares at a strike of $116.00/share # Output In the LBO analysis file create a new sensitivity table, with the Entry Premium % of 5% and 15%. Also show the Exit Multiple of 16x, 18x and 20x. Round final monetary values to nearest million. Round all other values to 1 decimal point.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual0/6FailShare pagePublic trace
Gemini 3.1 Produal0/6FailShare pagePublic trace
GPT-5.4 minidual6/6PassShare pagePublic trace
GPT-5.4 nanodual6/6PassShare pagePublic trace

Grading rubric

Criteria and grader verdict (showcase run)

  1. States that IRR is 16.1% for 5.0% premium and 16.0x exit multiple

    Fail

    Evidence: <TEXT_RESPONSE> table shows for 16.0x exit multiple and 5.0% premium: “15.4%”. Assessment: Criterion requires stating IRR is 16.1% for 5.0% premium and 16.0x exit multiple; the response states 15.4%, so fail.

  2. States that IRR is 10.9% for 15.0% premium and 16.0x exit multiple

    Fail

    Evidence: <TEXT_RESPONSE> table shows for 16.0x exit multiple and 15.0% premium: “10.3%”. Assessment: Criterion requires stating IRR is 10.9% for 15.0% premium and 16.0x exit multiple; the response states 10.3%, so fail.

  3. States that IRR is 18.8% for 5.0% premium and 18.0x exit multiple

    Fail

    Evidence: <TEXT_RESPONSE> table shows for 18.0x exit multiple and 5.0% premium: “18.2%”. Assessment: Criterion requires stating IRR is 18.8% for 5.0% premium and 18.0x exit multiple; the response states 18.2%, so fail.

  4. States that IRR is 13.5% for 15.0% premium and 18.0x exit multiple

    Fail

    Evidence: <TEXT_RESPONSE> table shows for 18.0x exit multiple and 15.0% premium: “12.9%”. Assessment: Criterion requires stating IRR is 13.5% for 15.0% premium and 18.0x exit multiple; the response states 12.9%, so fail.

  5. States that IRR is 21.3% for 5.0% premium and 20.0x exit multiple

    Fail

    Evidence: <TEXT_RESPONSE> table shows for 20.0x exit multiple and 5.0% premium: “20.7%”. Assessment: Criterion requires stating IRR is 21.3% for 5.0% premium and 20.0x exit multiple; the response states 20.7%, so fail.

  6. States that IRR is 15.9% for 15.0% premium and 20.0x exit multiple

    Fail

    Evidence: <TEXT_RESPONSE> table shows for 20.0x exit multiple and 15.0% premium: “15.3%”. Assessment: Criterion requires stating IRR is 15.9% for 15.0% premium and 20.0x exit multiple; the response states 15.3%, so fail.