Raycaster / evalsBack to AI Agents for M&A Legal Due Diligence

APEX-Agents · Investment Banking

World224-JR-02

1/5Fail

APEX-Agents task World224-JR-02 in AI Agents for M&A Legal Due Diligence. Compare dual-harness agent runs across models — rubric criteria, scores, and public traces.

AI Agents for M&A Legal Due DiligenceInvestment Banking World 224Dual harnessGrader: rubric
Task IDtask_80a7d5ad40cc4ed18e859cb9edf4d180
WorldInvestment Banking World 224
Expected outputmake_new_sheet
Published runs4 models · dual config

Task prompt

What the agent was asked to do

Assess how much certain business drivers must move to bring IRR below 20%. The stock price has fallen to $87.00. Use the LBO model for the info. 1. Find the critical point (percentages to 2 decimal places) for each of the below business drivers at which rounded IRR would be pushed down to 19.99% from above: a) 'Growth rate scale' (correct the approach for Year 1/2) b) 'Customer acquisition costs' c) 'R&D cost' d) 'Debt costs' e) 'EBITDA multiple' Assumptions and constraints: 1. EBITDA is not to fall below $91 million for any year. If this threshold is passed the new constraint becomes EBITDA for each individual year instead of the IRR. 2. 'Debt costs' should be set to 0% for all other sensitivities. Create a new sheet that shows values for the five major business drivers.

Published trajectories

Agent runs on this task

Curated dual-harness runs (parsed + original sandbox). Best scored run per model.

ModelHarnessScoreResultLinks
GPT-5.5showcasedual1/5FailShare pagePublic trace
Gemini 3.1 Produal0/5FailShare pagePublic trace
GPT-5.4 minidual2/5FailShare pagePublic trace
GPT-5.4 nanodual1/5FailShare pagePublic trace

Grading rubric

Criteria and grader verdict (showcase run)

  1. States Percentage Change for Growth rate scale is -5.80%

    Fail

    Evidence: TEXT_RESPONSE table states “Growth rate scale | Decrease | -5.55%”. Assessment: Criterion requires stating Percentage Change for Growth rate scale is -5.80%; the response states -5.55%, so it fails.

  2. States Percentage Change for Customer acquisition costs is 2.33%

    Fail

    Evidence: TEXT_RESPONSE table states “Customer acquisition costs | Increase | +2.34%”. Assessment: Criterion requires 2.33%; the response states 2.34%, not the required value, so it fails.

  3. States Percentage Change for R&D cost is 4.41%

    Pass

    Evidence: TEXT_RESPONSE table states “R&D cost | Increase | +4.41%” and note says “constrained point is therefore +4.41%”. Assessment: Criterion requires Percentage Change for R&D cost is 4.41%; this is clearly stated, so it passes.

  4. States Percentage Change for Debt costs scale is 121.97%

    Fail

    Evidence: TEXT_RESPONSE table states “Debt costs | Increase | +122.50%”. Assessment: Criterion requires Debt costs scale is 121.97%; the response states 122.50%, so it fails.

  5. States Percentage Change for EBITDA multiple is -3.68%

    Fail

    Evidence: TEXT_RESPONSE table states “EBITDA multiple | Decrease | -3.69%”. Assessment: Criterion requires EBITDA multiple is -3.68%; the response states -3.69%, so it fails.